00000001:02000400:0.0F:1789427691.518789:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789427698.704227:0:3488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789427699.521975:0:3550:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1591 MB/s 00000001:01000000:2.0:1789427699.771793:0:3550:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1815 MB/s 00000001:01000000:2.0:1789427700.021463:0:3550:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 11035 MB/s 00000020:02000000:2.0:1789427700.245166:0:3582:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g9380d02 00000400:02000000:3.0F:1789427700.527455:0:3597:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.124@tcp [8/256/0/180] 00008000:02000000:2.0:1789427702.750963:0:3747:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789427722.194547:0:5711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789427726.725127:0:6460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789427726.725131:0:6460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789427726.725132:0:6460:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789427726.725292:0:6460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002d264121 00000080:02000400:3.0:1789427726.725301:0:6460:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789427726.728224:0:6460:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789427726.728234:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789427726.728256:0:6460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e3e2d711) 00000020:00000080:3.0:1789427726.728270:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789427726.751598:0:6460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789427726.751675:0:6460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789427726.764165:0:6460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789427726.764359:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789427726.764366:0:6460:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789427726.764377:0:6460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede517e00 00000020:01000004:1.0:1789427726.764383:0:6460:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789427726.764387:0:6460:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789427726.764391:0:6460:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d264121 from MGS 00000020:01000004:1.0:1789427726.764394:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789427726.764410:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005a824b64) 00000020:00000080:1.0:1789427726.764564:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789427726.764664:0:6460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d264121 from MGS, refs=2 00080000:01000000:1.0:1789427726.764670:0:6460:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789427726.764679:0:6460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede517e0e 00000100:00100000:1.0:1789427726.764801:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789427726.764930:0:6460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789427726.764935:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789427726.765272:0:6460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789427726.765281:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789427726.765916:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427726.766063:0:6460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789427726.766069:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789427726.766761:0:6460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789427726.766768:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789427726.766981:0:6460:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789427726.766988:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789427726.767496:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427726.767502:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427726.767505:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427726.767834:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427726.767837:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427726.767840:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427726.768223:0:6460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789427726.769668:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789427727.017471:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6831 MB/s 00000001:01000000:3.0:1789427727.267523:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8035 MB/s 00000001:01000000:3.0:1789427727.518254:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1527 MB/s 00000001:01000000:3.0:1789427727.767515:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1855 MB/s 00080000:10000000:3.0:1789427727.770809:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789427727.776550:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789427727.776973:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789427727.776985:0:6460:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789427727.777013:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789427727.777096:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789427727.777109:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789427727.777514:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427727.777699:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789427727.777717:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789427727.778129:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789427727.778138:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789427727.778356:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789427727.778361:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789427727.778781:0:6479:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789427727.778791:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789427727.778809:0:6460:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.124@tcp' 00000020:01000004:2.0:1789427727.778811:0:6460:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789427727.778853:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.124@tcp (typ=mgc) 00000020:00000080:2.0:1789427727.778872:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.124@tcp (00000000096d0f9e) 00000020:00000080:2.0:1789427727.778887:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789427727.779020:0:6460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000048d2bed0@MGC192.168.202.124@tcp: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789427727.779250:0:6460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.124@tcp-0 is initialized 00000040:01000000:2.0:1789427727.779256:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789427727.780662:0:6481:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789427727.780702:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.124@tcp (uuid 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6) 00000020:00000080:1.0:1789427727.780717:0:6460:0:(genops.c:1384:class_connect()) connect: client 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6, cookie 0x84fc867ede517e1c 00000100:00080000:1.0:1789427727.780726:0:6460:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789427727.780732:0:6460:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import 0000000048d2bed0 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427727.780767:0:6460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000084f0da31 x1876350939955328/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427727.780801:0:6460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS 00000020:01000004:1.0:1789427727.780817:0:6460:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789427727.780840:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789427727.780848:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ba3958ab) 00000020:00000080:1.0:1789427727.780856:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789427727.780905:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084f0da31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350939955328:0@lo:250: 00000100:00100000:3.0:1789427727.780982:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427727.781064:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955328 00000100:00100000:3.0:1789427727.781072:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955328 00000100:00100000:3.0:1789427727.781100:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427727.781108:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3156858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3612:x1876350939955328:12345-0@lo:250: 00010000:00080000:3.0:1789427727.781142:0:6475:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6@0@lo t0 exp 0000000000000000 cur 72 last 0 00000020:00000080:3.0:1789427727.781166:0:6475:0:(genops.c:1384:class_connect()) connect: client 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6, cookie 0x84fc867ede517e2a 00000100:00080000:3.0:1789427727.781433:0:6475:0:(import.c:65:import_set_state_nolock()) 000000008c0b788f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427727.781497:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3156858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:3612:x1876350939955328:12345-0@lo:250: Request processed in 388us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427727.781507:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427727.781576:0:3612:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789427727.781585:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.124@tcp: connect to target with instance 0 00000100:00080000:3.0:1789427727.781591:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789427727.781595:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789427727.781599:0:3612:0:(import.c:65:import_set_state_nolock()) 0000000048d2bed0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789427727.781602:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789427727.781611:0:3612:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789427727.781620:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084f0da31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350939955328:0@lo:250: 00000100:00100000:1.0:1789427727.785963:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.786143:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789427727.786149:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789427727.786629:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789427727.786641:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789427727.786866:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789427727.786871:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789427727.787306:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.787394:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789427727.787397:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789427727.787768:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789427727.787773:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:2.0:1789427727.792566:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427727.805659:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.805830:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789427727.805835:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789427727.806496:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789427727.806503:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789427727.806908:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.807009:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789427727.807014:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789427727.807333:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427727.807338:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789427727.807808:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427727.807908:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789427727.807912:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789427727.808219:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427727.808224:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789427727.808659:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.808797:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789427727.808802:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789427727.809072:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427727.809078:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789427727.817994:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427727.818163:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789427727.818174:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789427727.819012:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789427727.819017:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789427727.819581:0:6460:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789427727.819588:0:6460:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789427727.820128:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789427727.820149:0:6460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789427727.820156:0:6460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789427727.820247:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789427727.820282:0:6460:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789427727.820286:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789427727.820287:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427727.820288:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427727.820289:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427727.820289:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427727.820290:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427727.820291:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427727.820292:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427727.820293:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427727.820294:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427727.820295:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427727.820295:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427727.820297:0:6460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789427727.820298:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427727.820299:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427727.820300:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427727.820300:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427727.820301:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427727.820301:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427727.820302:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427727.820302:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427727.820303:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427727.820303:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427727.820304:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427727.820307:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427727.820326:0:6460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789427727.820336:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955456:0@lo:253: 00000100:00100000:1.0:1789427727.820387:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427727.820455:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955456 00000100:00100000:0.0:1789427727.820464:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955456 00000100:00100000:1.0:1789427727.820465:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076bca275 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.820534:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427727.820546:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a037165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:6460:x1876350939955456:12345-0@lo:253: 20000000:01000000:0.0:1789427727.820598:0:6478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789427727.820602:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789427727.820784:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789427727.820806:0:6478:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789427727.821102:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427727.821760:0:6499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789427727.821850:0:6478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789427727.821853:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789427727.821858:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789427727.821861:0:6478:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789427727.821873:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789427727.821949:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427727.822084:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789427727.822098:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789427727.822115:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789427727.822130:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789427727.822144:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789427727.822191:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789427727.822199:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789427727.822213:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789427727.822219:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789427727.822231:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789427727.822236:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789427727.822249:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789427727.822277:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789427727.822303:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789427727.822309:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789427727.822316:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427727.822399:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789427727.822407:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789427727.822439:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789427727.822450:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789427727.822458:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789427727.822463:0:6478:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789427727.822477:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789427727.822481:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789427727.822487:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789427727.822494:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789427727.822502:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789427727.822507:0:6478:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789427727.822518:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789427727.822535:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789427727.822547:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789427727.822556:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789427727.822593:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789427727.822606:0:6478:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789427727.822610:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789427727.822805:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789427727.822872:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789427727.822883:0:6478:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.124@tcp for mdt 20000000:01000000:0.0:1789427727.822885:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:0.0:1789427727.822892:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789427727.822894:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789427727.822901:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789427727.822904:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:0.0:1789427727.822910:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789427727.822914:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789427727.822927:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789427727.822935:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789427727.822950:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789427727.822952:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789427727.822955:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789427727.823003:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789427727.823005:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789427727.823196:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789427727.823278:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789427727.823290:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789427727.823298:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789427727.823302:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789427727.823303:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789427727.823496:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789427727.823560:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789427727.823572:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789427727.823579:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789427727.823586:0:6478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789427727.823587:0:6478:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789427727.823589:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789427727.823590:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789427727.823593:0:6478:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789427727.823597:0:6478:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789427727.823751:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789427727.823788:0:6478:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789427727.827454:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789427727.827480:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789427727.827496:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789427727.827510:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789427727.827545:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827559:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827576:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827581:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827587:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827593:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827599:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000acacfc51 already unused, calling callback (000000002c5e5a21) 00010000:00010000:0.0:1789427727.827602:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827608:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827619:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827626:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.827631:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000acacfc51/0x84fc867ede517e31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789427727.827646:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789427727.831965:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a037165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:6460:x1876350939955456:12345-0@lo:253: Request processed in 11418us (11573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.831990:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427727.832010:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955456:0@lo:253: 10000000:01000000:1.0:1789427727.832028:0:6460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789427727.832031:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427727.832033:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427727.832034:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427727.832035:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789427727.832037:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427727.832038:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427727.832039:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427727.832040:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427727.832041:0:6460:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789427727.832042:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427727.832107:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789427727.832124:0:6460:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d264121 from lustre-MDT0000 10000000:01000000:1.0:1789427727.832152:0:6460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789427727.832155:0:6460:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789427727.832159:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff919688454d40 10000000:01000000:1.0:1789427727.832163:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427727.832170:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688454d40 from 1 10000000:01000000:1.0:1789427727.832173:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789427727.832207:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.832218:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.832226:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.832250:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955584:0@lo:101: 00000100:00100000:1.0:1789427727.832298:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.832344:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.832598:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955584 00000100:00100000:2.0:1789427727.832605:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955584 00000100:00100000:2.0:1789427727.832639:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427727.832646:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ded222b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:6460:x1876350939955584:12345-0@lo:101: 00010000:00010000:2.0:1789427727.832657:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427727.832669:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517e38 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.832688:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517e38 expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.832697:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517e38 expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.832704:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b03714d, rc 0) 00000100:00100000:2.0:1789427727.832752:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ded222b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:6460:x1876350939955584:12345-0@lo:101: Request processed in 107us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.832763:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427727.832889:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955584:0@lo:101: 00010000:00010000:1.0:1789427727.832901:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.832908:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.832960:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955712:0@lo:501: 00000100:00100000:1.0:1789427727.832985:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.833009:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.833026:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955712 00000100:00100000:0.0:1789427727.833032:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955712 00000100:00100000:0.0:1789427727.833060:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789427727.833065:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b59001ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:6460:x1876350939955712:12345-0@lo:501: 00000100:00100000:0.0:1789427727.833139:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b59001ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:6460:x1876350939955712:12345-0@lo:501: Request processed in 74us (154us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427727.833146:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427727.833205:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955712:0@lo:501: 10000000:01000000:1.0:1789427727.833234:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789427727.833248:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833258:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.833263:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919684ed8800 10000000:01000000:1.0:1789427727.833266:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789427727.833268:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff919684ed8800 10000000:01000000:1.0:1789427727.833270:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789427727.833272:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff919684ed8800 from 1 10000000:01000000:1.0:1789427727.833278:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789427727.833289:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833293:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833298:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.833304:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955840:0@lo:101: 00000100:00100000:1.0:1789427727.833335:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.833353:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.833389:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955840 00000100:00100000:2.0:1789427727.833393:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955840 00000100:00100000:2.0:1789427727.833454:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427727.833462:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000443c6d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:6460:x1876350939955840:12345-0@lo:101: 00010000:00010000:2.0:1789427727.833469:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427727.833477:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d2c9a61/0x84fc867ede517e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517e46 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.833490:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d2c9a61/0x84fc867ede517e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517e46 expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.833498:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d2c9a61/0x84fc867ede517e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517e46 expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.833504:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d2c9a61, rc 0) 00000100:00100000:2.0:1789427727.833541:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000443c6d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+7:6460:x1876350939955840:12345-0@lo:101: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.833547:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427727.833576:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955840:0@lo:101: 00010000:00010000:1.0:1789427727.833587:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833594:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.833603:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789427727.833611:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833617:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 000000001235a186/0x84fc867ede517e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.833624:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789427727.833628:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427727.833632:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff919684ed8800 10000000:01000000:1.0:1789427727.833639:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789427727.833642:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789427727.833644:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789427727.833656:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833662:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833668:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.833677:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955968:0@lo:101: 00000100:00100000:1.0:1789427727.833699:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.833720:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.833738:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939955968 00000100:00100000:0.0:1789427727.833743:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939955968 00000100:00100000:0.0:1789427727.833766:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427727.833780:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007cfa5906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+7:6460:x1876350939955968:12345-0@lo:101: 00010000:00010000:0.0:1789427727.833786:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427727.833793:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517e54 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.833804:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517e54 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.833811:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517e54 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.833817:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000562b9e3d, rc 0) 00000100:00100000:0.0:1789427727.833848:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007cfa5906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+8:6460:x1876350939955968:12345-0@lo:101: Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.833853:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427727.833887:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939955968:0@lo:101: 00010000:00010000:1.0:1789427727.833896:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.833903:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.833937:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956096:0@lo:501: 00000100:00100000:1.0:1789427727.833959:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.833976:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.834006:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956096 00000100:00100000:2.0:1789427727.834011:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956096 00000100:00100000:2.0:1789427727.834034:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427727.834040:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da71b2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+8:6460:x1876350939956096:12345-0@lo:501: 00000100:00100000:2.0:1789427727.834155:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da71b2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6460:x1876350939956096:12345-0@lo:501: Request processed in 115us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.834161:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427727.834193:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956096:0@lo:501: 00000100:00100000:1.0:1789427727.834228:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956224:0@lo:503: 00000100:00100000:1.0:1789427727.834258:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.834290:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650cf360 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.834312:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956224 00000100:00100000:0.0:1789427727.834318:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956224 00000100:00100000:0.0:1789427727.834351:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427727.834357:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb34c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6460:x1876350939956224:12345-0@lo:503: 00000100:00100000:0.0:1789427727.834463:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb34c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6460:x1876350939956224:12345-0@lo:503: Request processed in 104us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.834471:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789427727.834478:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956224:0@lo:503: 00000100:00100000:3.0:1789427727.834725:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6504:1876350939956352:0@lo:502: 00000100:00100000:3.0:1789427727.834762:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427727.834787:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017dda044 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.834814:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956352 00000100:00100000:2.0:1789427727.834819:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956352 00000100:00100000:2.0:1789427727.834852:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427727.834859:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fdbcbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6504:x1876350939956352:12345-0@lo:502: 00000100:00100000:2.0:1789427727.834932:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fdbcbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6504:x1876350939956352:12345-0@lo:502: Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.834940:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789427727.834946:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6504:1876350939956352:0@lo:502: 00000020:01000000:3.0:1789427727.834974:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427727.834991:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427727.834995:0:6504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789427727.835000:0:6504:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789427727.835003:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427727.835014:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000483e9ca5) 00000020:00000080:3.0:1789427727.835027:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789427727.835031:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789427727.835101:0:6504:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789427727.835108:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede517e69 00000020:00000080:3.0:1789427727.835288:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789427727.835291:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427727.835293:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427727.835294:0:6504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789427727.835296:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427727.835298:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427727.835299:0:6504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789427727.835300:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427727.835305:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a96ea2e5) 00000020:00000080:3.0:1789427727.835311:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789427727.835313:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789427727.835314:0:6504:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789427727.835316:0:6504:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789427727.835320:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789427727.835356:0:6504:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d264121 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789427727.835367:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f5a3b2ee) 00000020:00000080:3.0:1789427727.835374:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789427727.835457:0:6504:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789427727.835461:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede517e7e 00000020:00000080:3.0:1789427727.835550:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789427727.835556:0:6504:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789427727.835561:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x84fc867ede517e85 00080000:01000000:3.0:1789427727.835565:0:6504:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789427727.835568:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede517e8c 00080000:10000000:3.0:1789427727.835905:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789427727.836054:0:6504:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789427727.837987:0:6504:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789427727.870625:0:6504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789427727.870872:0:6504:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789427727.872086:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789427727.872286:0:6504:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789427727.873964:0:6504:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f5acb9d3) 00000020:00000080:3.0:1789427727.873982:0:6504:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789427727.874068:0:6504:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789427727.874077:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede517e9a 00000020:00000080:3.0:1789427727.874461:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789427727.875268:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789427727.876675:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789427727.878078:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789427727.879475:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789427727.881045:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789427727.882359:0:6504:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789427727.883876:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x84fc867ede517ea1 00000020:00000080:0.0:1789427727.884230:0:6504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789427727.884246:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427727.884253:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427727.884255:0:6504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789427727.884259:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427727.884263:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427727.884264:0:6504:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789427727.884266:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789427727.884267:0:6504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789427727.884270:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427727.884271:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427727.884272:0:6504:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789427727.884273:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427727.884277:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427727.884278:0:6504:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789427727.884281:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789427727.884342:0:6504:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789427727.884453:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fd84cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6504:1876350939956480:0@lo:502: 00000100:00100000:0.0:1789427727.884564:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.884615:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956480 00000100:00100000:1.0:1789427727.884626:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956480 00000100:00100000:0.0:1789427727.884637:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004251b13 going to sleep for 11 seconds 00000100:00100000:1.0:1789427727.884686:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427727.884698:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd54a8fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6504:x1876350939956480:12345-0@lo:502: 00000100:00100000:1.0:1789427727.884854:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd54a8fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6504:x1876350939956480:12345-0@lo:502: Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427727.884861:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789427727.884915:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fd84cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6504:1876350939956480:0@lo:502: 00000020:01000000:0.0:1789427727.884943:0:6504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427727.884946:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427727.884947:0:6504:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789427727.884949:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789427727.885057:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789427727.885073:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789427727.885091:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.885100:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.885107:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919684ed8800 from 1 10000000:01000000:1.0:1789427727.885110:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427727.885137:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.885150:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.885163:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.885182:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956608:0@lo:101: 00000100:00100000:1.0:1789427727.885226:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.885244:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.885262:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956608 00000100:00100000:2.0:1789427727.885267:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956608 00000100:00100000:2.0:1789427727.885289:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789427727.885293:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f957be22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:6460:x1876350939956608:12345-0@lo:101: 00010000:00010000:2.0:1789427727.885303:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427727.885312:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517ea8 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.885327:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.885334:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.885339:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006911299c, rc 0) 00000100:00100000:2.0:1789427727.885362:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f957be22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:6460:x1876350939956608:12345-0@lo:101: Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.885366:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427727.885402:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956608:0@lo:101: 00010000:00010000:1.0:1789427727.885439:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.885449:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.885926:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956736:0@lo:256: 00000100:00100000:1.0:1789427727.885950:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.885972:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.886003:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956736 00000100:00100000:0.0:1789427727.886011:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956736 00000100:00100000:0.0:1789427727.886074:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427727.886084:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ecb30be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:6460:x1876350939956736:12345-0@lo:256: 20000000:01000000:0.0:1789427727.886107:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789427727.886114:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789427727.886216:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ecb30be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:6460:x1876350939956736:12345-0@lo:256: Request processed in 134us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.886224:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789427727.886543:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956736:0@lo:256: 10000000:01000000:1.0:1789427727.887055:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427727.887070:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.887078:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.887083:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919684ed8800 from 1 10000000:01000000:1.0:1789427727.887084:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427727.887101:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.887105:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.887110:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.887885:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956864:0@lo:101: 00000100:00100000:1.0:1789427727.887931:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427727.887968:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956864 00000100:00100000:1.0:1789427727.887972:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.887974:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956864 00000100:00100000:2.0:1789427727.888010:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789427727.888015:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fff9bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:6460:x1876350939956864:12345-0@lo:101: 00010000:00010000:2.0:1789427727.888024:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427727.888041:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517eb6 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.888056:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.888063:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427727.888068:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb50f008, rc 0) 00000100:00100000:2.0:1789427727.888099:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fff9bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939956864:12345-0@lo:101: Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.888104:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427727.888134:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956864:0@lo:101: 00010000:00010000:1.0:1789427727.888146:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.888154:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.888202:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956992:0@lo:501: 00000100:00100000:1.0:1789427727.888219:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.888233:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.888268:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939956992 00000100:00100000:0.0:1789427727.888279:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939956992 00000100:00100000:0.0:1789427727.888326:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427727.888334:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084ab8100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939956992:12345-0@lo:501: 00000100:00100000:0.0:1789427727.888655:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084ab8100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939956992:12345-0@lo:501: Request processed in 320us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.888665:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427727.888675:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939956992:0@lo:501: 00000100:00100000:1.0:1789427727.888701:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957120:0@lo:503: 00000100:00100000:1.0:1789427727.888733:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.888757:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.888765:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957120 00000100:00100000:2.0:1789427727.888770:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957120 00000100:00100000:2.0:1789427727.888799:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427727.888806:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063030fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939957120:12345-0@lo:503: 00000040:00080000:2.0:1789427727.888847:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789427727.888895:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063030fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939957120:12345-0@lo:503: Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.888902:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427727.888917:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957120:0@lo:503: 00000040:00080000:2.0:1789427727.889618:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789427727.889678:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789427727.889701:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427727.889719:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.889729:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.889788:0:6460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789427727.889791:0:6460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919684ed8800 10000000:01000000:1.0:1789427727.889794:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919684ed8800 10000000:01000000:1.0:1789427727.889798:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427727.889802:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919684ed8800 from 1 10000000:01000000:1.0:1789427727.889804:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789427727.889823:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.889831:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.889838:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.889850:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957248:0@lo:101: 00000100:00100000:1.0:1789427727.889879:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.889907:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.889931:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957248 00000100:00100000:0.0:1789427727.889939:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957248 00000100:00100000:0.0:1789427727.889976:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427727.889984:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ea6ad57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6460:x1876350939957248:12345-0@lo:101: 00010000:00010000:0.0:1789427727.890003:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427727.890021:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517ec4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.890058:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.890069:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.890093:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000acacfc51, rc 0) 00000100:00100000:0.0:1789427727.890144:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ea6ad57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939957248:12345-0@lo:101: Request processed in 162us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.890151:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427727.890191:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957248:0@lo:101: 00010000:00010000:1.0:1789427727.890207:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.890217:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427727.890271:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957376:0@lo:501: 00000100:00100000:1.0:1789427727.890302:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.890327:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.890347:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957376 00000100:00100000:2.0:1789427727.890353:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957376 00000100:00100000:2.0:1789427727.890386:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789427727.890393:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9f5cd9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939957376:12345-0@lo:501: 00000100:00100000:2.0:1789427727.890532:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9f5cd9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939957376:12345-0@lo:501: Request processed in 129us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.890540:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789427727.890686:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957376:0@lo:501: 00000100:00100000:1.0:1789427727.890710:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957504:0@lo:503: 00000100:00100000:1.0:1789427727.890736:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.890758:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da466614 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.890784:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957504 00000100:00100000:0.0:1789427727.890791:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957504 00000100:00100000:0.0:1789427727.890822:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427727.890827:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001cdc6158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939957504:12345-0@lo:503: 00000100:00100000:0.0:1789427727.890920:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001cdc6158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939957504:12345-0@lo:503: Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.890925:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789427727.890959:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939957504:0@lo:503: 00000100:00100000:3.0:1789427727.891325:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6509:1876350939957632:0@lo:502: 00000100:00100000:3.0:1789427727.891377:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427727.891406:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7eebac8 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.891465:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957632 00000100:00100000:2.0:1789427727.891473:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957632 00000100:00100000:2.0:1789427727.891519:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789427727.891541:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000488c2876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6509:x1876350939957632:12345-0@lo:502: 00000100:00100000:2.0:1789427727.891629:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000488c2876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6509:x1876350939957632:12345-0@lo:502: Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427727.891635:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789427727.891682:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6509:1876350939957632:0@lo:502: 00000020:01000004:3.0:1789427727.891774:0:6509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789427727.891794:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005cac25b9) 00000020:00000080:3.0:1789427727.891817:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789427727.891915:0:6509:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d264121 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789427727.891919:0:6509:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002d264121 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789427727.891921:0:6509:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002d264121 4 00010000:00080000:3.0:1789427727.891956:0:6509:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f672a4d2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789427727.893827:0:6509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789427727.894067:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789427727.894106:0:6509:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789427727.894117:0:6509:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x84fc867ede517ed9 00000100:00080000:3.0:1789427727.894126:0:6509:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789427727.894136:0:6509:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f672a4d2 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427727.894181:0:6509:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d4002d5c x1876350939957760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789427727.894212:0:6509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789427727.894273:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350939957760:0@lo:38: 00000100:00100000:0.0:1789427727.894347:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427727.894537:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957760 00000100:00100000:3.0:1789427727.894546:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957760 00000100:00100000:3.0:1789427727.894584:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427727.894590:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fd84cfa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350939957760:12345-0@lo:38: 00000100:00100000:3.0:1789427727.894654:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fd84cfa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350939957760:12345-0@lo:38: Request processed in 62us (307us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789427727.894664:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427727.894675:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789427727.894687:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000f672a4d2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789427727.894695:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789427727.894700:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4002d5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350939957760:0@lo:38: 00000100:00100000:3.0:1789427727.894779:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9db2ce4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6509:1876350939957888:0@lo:502: 00000100:00100000:3.0:1789427727.894830:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427727.894862:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9e27874 going to sleep for 11 seconds 00000100:00100000:0.0:1789427727.894886:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939957888 00000100:00100000:0.0:1789427727.894892:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939957888 00000100:00100000:0.0:1789427727.894946:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427727.894956:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ad5a92f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6509:x1876350939957888:12345-0@lo:502: 00000100:00100000:0.0:1789427727.895103:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ad5a92f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6509:x1876350939957888:12345-0@lo:502: Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.895112:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789427727.895128:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9db2ce4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6509:1876350939957888:0@lo:502: 00000040:00080000:3.0:1789427727.895167:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789427727.895267:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789427727.895310:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427727.895327:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.895339:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427727.895389:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789427727.895392:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427727.895393:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427727.895396:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427727.895398:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427727.895399:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427727.895401:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427727.895402:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427727.895404:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427727.895406:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427727.895408:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427727.895409:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427727.895473:0:6460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789427727.895476:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427727.895478:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427727.895479:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427727.895481:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427727.895482:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427727.895484:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427727.895485:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427727.895486:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427727.895487:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427727.895489:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427727.895490:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427727.895491:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427727.895509:0:6460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789427727.895519:0:6460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f2cf529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939958016:0@lo:253: 00000100:00100000:0.0:1789427727.895577:0:6460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427727.895611:0:6460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c108e5df going to sleep for 11 seconds 00000100:00100000:1.0:1789427727.895641:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958016 00000100:00100000:1.0:1789427727.895655:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958016 00000100:00100000:1.0:1789427727.895716:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789427727.895727:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f0cd930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939958016:12345-0@lo:253: 20000000:01000000:1.0:1789427727.895761:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789427727.895774:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789427727.898970:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789427727.898987:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789427727.899012:0:6498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789427727.899026:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789427727.899047:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899067:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899076:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899117:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899137:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427727.899155:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001aa370ae pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939958144:0@lo:104: 00000100:00100000:0.0:1789427727.899225:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427727.899244:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f0cd930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6460:x1876350939958016:12345-0@lo:253: Request processed in 3518us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427727.899254:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427727.899276:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dbf06d63 going to sleep for 11 seconds 00000100:00100000:2.0:1789427727.899282:0:6460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f2cf529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6460:1876350939958016:0@lo:253: 10000000:01000000:2.0:1789427727.899302:0:6460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789427727.899306:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789427727.899308:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789427727.899311:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789427727.899312:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789427727.899313:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1789427727.899313:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958144 00000020:01000004:2.0:1789427727.899317:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789427727.899318:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789427727.899319:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789427727.899320:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000100:00100000:1.0:1789427727.899320:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958144 00000020:01000004:2.0:1789427727.899323:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789427727.899325:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789427727.899326:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789427727.899349:0:6460:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789427727.899357:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427727.899368:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789427727.899369:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004836e305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939958144:12345-0@lo:104: 00000100:00100000:0.0:1789427727.899378:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789427727.899383:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899455:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427727.899459:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004836e305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939958144:12345-0@lo:104: Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427727.899464:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001aa370ae pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939958144:0@lo:104: 00000100:00100000:1.0:1789427727.899465:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789427727.899489:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899494:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427727.899501:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899507:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6bc81a4 already unused, calling callback (00000000cd629de8) 10000000:00010000:1.0:1789427727.899511:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899517:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427727.899533:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427727.899540:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427727.899564:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899569:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427727.899584:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899588:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000e6bc81a4/0x84fc867ede517ea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517eaf expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427727.899602:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427727.899603:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427727.899604:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427727.899702:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939958272:0@lo:103: 00000100:00100000:3.0:1789427727.899766:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427727.899820:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958272 00000100:00100000:0.0:1789427727.899827:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958272 00010000:00010000:0.0:1789427727.899848:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427727.899885:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427727.899894:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9db2ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3614:x1876350939958272:12345-0@lo:103: 00000100:00100000:3.0:1789427727.899901:0:6469:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789427727.899913:0:6469:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789427727.899916:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427727.899923:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899935:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899947:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006911299c/0x84fc867ede517eaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517ea8 expref: 12 pid: 6477 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899963:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899973:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789427727.899988:0:6468:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000964032s 00010000:00010000:0.0:1789427727.899992:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.899999:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900005:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900014:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900020:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010fde08f already unused, calling callback (000000002c5e5a21) 00010000:00010000:0.0:1789427727.900024:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900041:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900059:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427727.900070:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427727.900119:0:6498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427727.900124:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9db2ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:3614:x1876350939958272:12345-0@lo:103: Request processed in 230us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427727.900138:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427727.900140:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789427727.900152:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010fde08f/0x84fc867ede517ee0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427727.900176:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939958272:0@lo:103: 00080000:10000000:2.0:1789427727.902552:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.902689:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789427727.902860:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.902962:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789427727.903074:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.903189:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789427727.903749:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.903910:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789427727.904080:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.904240:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789427727.904478:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789427727.904719:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789427727.907173:0:6460:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789427727.911192:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789427727.911472:0:6517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1789427727.911672:0:6516:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789427727.911676:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789427727.912881:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789427727.912998:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789427727.913358:0:6460:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789427727.913372:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789427727.913663:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427727.914209:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427727.914602:0:6460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789427727.915047:0:6460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789427727.915073:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789427727.915204:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789427727.915377:0:6460:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789427727.915874:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789427727.915954:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789427727.916039:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789427727.916118:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789427727.916220:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789427727.916321:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789427727.916504:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789427727.916616:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789427727.916702:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789427727.916781:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789427727.916868:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789427727.916946:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789427727.917038:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:3.0:1789427727.917089:0:6517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:2.0:1789427727.917130:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000004:00080000:3.0:1789427727.917154:0:6517:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789427727.917159:0:6517:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789427727.917295:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789427727.917384:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789427727.917585:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789427727.917674:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789427727.917757:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789427727.917884:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789427727.917976:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789427727.918070:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789427727.918155:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789427727.918249:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789427727.918378:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789427727.918549:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789427727.918637:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789427727.918717:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789427727.918794:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789427727.918886:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789427727.918972:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789427727.919057:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789427727.919179:0:6460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789427727.920837:0:6460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789427727.920859:0:6460:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb489c19ab988 00100000:10000000:2.0:1789427727.920864:0:6460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789427727.921177:0:6460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789427727.921190:0:6460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789427727.921213:0:6460:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789427727.921226:0:6460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789427727.921931:0:6460:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427727.922115:0:6460:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789427728.816538:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427729.308327:0:6761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789427729.672093:0:6813:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789427729.672274:0:6813:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789427729.842586:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427730.865648:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427731.354031:0:6915:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427731.354185:0:6915:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789427731.890997:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427732.912624:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427733.296637:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adb9908a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939958400:0@lo:400: 00000100:00100000:3.0:1789427733.296705:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427733.296747:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958400 00000100:00100000:0.0:1789427733.296755:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958400 00000100:00080000:1.0:1789427733.296790:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789427733.296796:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427733.296799:0:469:0:(import.c:65:import_set_state_nolock()) 00000000f672a4d2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789427733.296807:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789427733.296812:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f672a4d2 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789427733.296817:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000752dbe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:3615:x1876350939958400:12345-0@lo:400: 00000100:00100000:1.0:1789427733.296837:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009b1a6783 x1876350939958528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789427733.296902:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350939958528:0@lo:38: 00000100:00100000:1.0:1789427733.296938:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427733.296974:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958528 00000100:00100000:2.0:1789427733.296980:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958528 00000100:00100000:2.0:1789427733.297009:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427733.297013:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000faf4f99b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350939958528:12345-0@lo:38: 00010000:00080000:2.0:1789427733.297033:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 77 last 0 00000100:00100000:0.0:1789427733.297065:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000752dbe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:3615:x1876350939958400:12345-0@lo:400: Request processed in 249us (359us total) trans 0 rc 0/0 00000020:00000080:2.0:1789427733.297066:0:6484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x84fc867ede517ee7 00000100:00100000:3.0:1789427733.297072:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adb9908a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939958400:0@lo:400: 00000100:00100000:0.0:1789427733.297078:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:2.0:1789427733.297103:0:6484:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789427733.297217:0:6484:0:(import.c:65:import_set_state_nolock()) 00000000270bb4fa : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427733.297253:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000faf4f99b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1876350939958528:12345-0@lo:38: Request processed in 239us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427733.297257:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789427733.297287:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b1a6783 x1876350939958528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789427733.297302:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789427733.297309:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789427733.297314:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789427733.297322:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000f672a4d2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427733.297339:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350939958528:0@lo:38: 00010000:00010000:1.0:1789427733.937225:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789427734.832499:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789427734.832507:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919684ed8800 from 3 10000000:01000000:3.0:1789427734.832513:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789427734.832556:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427734.832568:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427734.832579:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427734.832603:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b449a02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939958656:0@lo:101: 00000100:00100000:3.0:1789427734.832684:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427734.832738:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958656 00000100:00100000:3.0:1789427734.832744:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000478a2b4d going to sleep for 11 seconds 00000100:00100000:1.0:1789427734.832746:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958656 00000100:00100000:1.0:1789427734.832799:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789427734.832807:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b736c8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6481:x1876350939958656:12345-0@lo:101: 00010000:00010000:1.0:1789427734.832826:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427734.832838:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517eee expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427734.832860:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517eee expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427734.832870:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517eee expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427734.832879:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000de8cb4a, rc 0) 00000100:00100000:1.0:1789427734.832920:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b736c8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939958656:12345-0@lo:101: Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427734.832928:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427734.832972:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b449a02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939958656:0@lo:101: 00010000:00010000:3.0:1789427734.832988:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427734.832997:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427734.833046:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b449a02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939958784:0@lo:256: 00000100:00100000:3.0:1789427734.833077:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427734.833099:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000478a2b4d going to sleep for 11 seconds 00000100:00100000:1.0:1789427734.833133:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958784 00000100:00100000:1.0:1789427734.833139:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958784 00000100:00100000:1.0:1789427734.833184:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789427734.833191:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e825012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939958784:12345-0@lo:256: 20000000:01000000:1.0:1789427734.833206:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789427734.833228:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789427734.833232:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789427734.833319:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e825012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939958784:12345-0@lo:256: Request processed in 128us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427734.833326:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427734.833339:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b449a02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939958784:0@lo:256: 10000000:01000000:0.0:1789427734.833395:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427734.833402:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427734.833411:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427734.961439:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789427735.857884:0:7412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789427735.857887:0:7412:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789427735.857889:0:7412:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789427735.857991:0:7412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002065787a 00000020:01000004:2.0:1789427735.858006:0:7412:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789427735.858016:0:7412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789427735.858027:0:7412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000ebfc138c) 00000020:00000080:2.0:1789427735.858042:0:7412:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789427735.872404:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789427735.872486:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789427735.881553:0:7412:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789427735.881732:0:7412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789427735.881740:0:7412:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789427735.881748:0:7412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede517f03 00000020:01000004:3.0:1789427735.881753:0:7412:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789427735.881769:0:7412:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789427735.881771:0:7412:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789427735.881775:0:7412:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789427735.881792:0:7412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789427735.881795:0:7412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789427735.891964:0:7412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789427735.892002:0:7412:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789427735.892006:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789427735.892007:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789427735.892008:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427735.892009:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789427735.892009:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427735.892010:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427735.892013:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789427735.892014:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789427735.892015:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789427735.892016:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427735.892016:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789427735.892019:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789427735.892020:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789427735.892021:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789427735.892022:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427735.892022:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789427735.892023:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427735.892023:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427735.892024:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789427735.892024:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789427735.892025:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789427735.892025:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427735.892026:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789427735.892049:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789427735.892064:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939958912:0@lo:253: 00000100:00100000:3.0:1789427735.892123:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.892167:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939958912 00000100:00100000:1.0:1789427735.892177:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939958912 00000100:00100000:3.0:1789427735.892180:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f955ef0e going to sleep for 11 seconds 00000100:00100000:1.0:1789427735.892229:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789427735.892235:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d103d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939958912:12345-0@lo:253: 20000000:01000000:1.0:1789427735.892265:0:6477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789427735.892272:0:6477:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789427735.892275:0:6477:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789427735.892278:0:6477:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789427735.892309:0:6477:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789427735.892488:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427735.892571:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789427735.892584:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427735.892595:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789427735.892604:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789427735.892611:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789427735.892642:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789427735.892647:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789427735.892654:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789427735.892657:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789427735.892663:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789427735.892666:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789427735.892672:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789427735.892679:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789427735.892738:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789427735.892746:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427735.892759:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789427735.892765:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427735.892778:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789427735.892783:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427735.892796:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789427735.892802:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789427735.892826:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789427735.892844:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789427735.892855:0:6477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789427735.892906:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789427735.892912:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789427735.892926:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789427735.892934:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789427735.892943:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789427735.892946:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789427735.892952:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789427735.892962:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789427735.892964:0:6477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789427735.892976:0:6477:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789427735.892981:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789427735.893257:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789427735.893341:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789427735.893354:0:6477:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.124@tcp for mdt 20000000:01000000:1.0:1789427735.893355:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427735.893363:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789427735.893366:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789427735.893372:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789427735.893374:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427735.893385:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789427735.893392:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789427735.893405:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789427735.893457:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789427735.893493:0:6477:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789427735.893498:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789427735.893751:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789427735.893846:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789427735.893861:0:6477:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.124@tcp for mdt 20000000:01000000:1.0:1789427735.893863:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427735.893877:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789427735.893882:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427735.893890:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789427735.893893:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427735.893899:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789427735.893909:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789427735.893921:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789427735.893937:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789427735.893954:0:6477:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789427735.893957:0:6477:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789427735.893961:0:6477:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789427735.894001:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789427735.894004:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427735.894177:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427735.894192:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427735.894200:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789427735.894247:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789427735.894259:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789427735.894270:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789427735.894274:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789427735.894275:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427735.894670:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427735.894685:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427735.894699:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789427735.894765:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789427735.894784:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789427735.894797:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789427735.894804:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789427735.894806:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427735.894954:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427735.894972:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427735.894986:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789427735.895043:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789427735.895065:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789427735.895082:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789427735.895093:0:6477:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789427735.895095:0:6477:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789427735.895099:0:6477:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789427735.895103:0:6477:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789427735.895320:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789427735.895352:0:6477:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789427735.901492:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789427735.901543:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901562:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901571:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517e54 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901577:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901584:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901617:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901630:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 12 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.901642:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001aa370ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959040:0@lo:104: 00000100:00100000:0.0:1789427735.901693:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.901741:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959040 00000100:00100000:2.0:1789427735.901748:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959040 00010000:00010000:0.0:1789427735.901753:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901762:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 12 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.901772:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2b887d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959168:0@lo:104: 00000100:00100000:2.0:1789427735.901789:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427735.901796:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.901800:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043c1d64e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939959040:12345-0@lo:104: 00010000:00010000:2.0:1789427735.901813:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.901816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959168 00000100:00100000:1.0:1789427735.901822:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959168 00010000:00010000:0.0:1789427735.901828:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.901837:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.901846:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d05ac41 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959296:0@lo:104: 00000100:00100000:1.0:1789427735.901854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427735.901869:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000872dc2e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6477:x1876350939959168:12345-0@lo:104: 00010000:00010000:1.0:1789427735.901875:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.901879:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427735.901882:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427735.901883:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427735.901890:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.901891:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043c1d64e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6477:x1876350939959040:12345-0@lo:104: Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.901905:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027518e83 going to sleep for 11 seconds 00010000:00010000:3.0:1789427735.901907:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8a471e9 already unused, calling callback (00000000cd629de8) 00000100:00100000:2.0:1789427735.901912:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:00010000:3.0:1789427735.901913:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.901920:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427735.901924:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.901928:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001aa370ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959040:0@lo:104: 00010000:00010000:1.0:1789427735.901929:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789427735.901934:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959296 00000100:00100000:1.0:1789427735.901938:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000872dc2e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939959168:12345-0@lo:104: Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.901941:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959296 00000100:00100000:0.0:1789427735.901945:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2b887d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959168:0@lo:104: 10000000:01000000:3.0:1789427735.901951:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789427735.901954:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427735.901979:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789427735.901986:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.901991:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cc73529 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939959296:12345-0@lo:104: 00010000:00010000:1.0:1789427735.901992:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427735.901996:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427735.902004:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902022:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902029:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024bdd101 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939959424:0@lo:103: 00010000:00010000:3.0:1789427735.902033:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000a8a471e9/0x84fc867ede517ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ecb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902048:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427735.902052:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427735.902055:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427735.902069:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427735.902072:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.902078:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cc73529 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939959296:12345-0@lo:104: Request processed in 91us (200us total) trans 0 rc 0/0 00010000:00010000:3.0:1789427735.902080:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427735.902085:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.902091:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789427735.902097:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd30a48b already unused, calling callback (00000000cd629de8) 10000000:00010000:3.0:1789427735.902099:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902104:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427735.902108:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.902111:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789427735.902116:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959424 00000100:00100000:1.0:1789427735.902120:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959424 00000100:00100000:0.0:1789427735.902123:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d05ac41 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939959296:0@lo:104: 00010000:00010000:1.0:1789427735.902137:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 13 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902147:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902155:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427735.902155:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902161:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789427735.902170:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902171:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b1a6783 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:3616:x1876350939959424:12345-0@lo:103: 00010000:00010000:3.0:1789427735.902182:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000fd30a48b/0x84fc867ede517e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e3f expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902185:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789427735.902186:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789427735.902191:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 13 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902192:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427735.902195:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427735.902198:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427735.902199:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f727881 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939959552:0@lo:103: 00010000:00010000:1.0:1789427735.902201:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 13 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902212:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000acacfc51/0x84fc867ede517ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517ec4 expref: 13 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902222:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427735.902250:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427735.902251:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427735.902255:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427735.902259:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427735.902261:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b1a6783 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3616:x1876350939959424:12345-0@lo:103: Request processed in 90us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1789427735.902267:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902267:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789427735.902275:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b81c9259 already unused, calling callback (00000000cd629de8) 10000000:00010000:3.0:1789427735.902278:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.902280:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959552 00010000:00010000:3.0:1789427735.902282:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.902286:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959552 10000000:00010000:3.0:1789427735.902287:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.902292:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427735.902303:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902313:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.902324:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024bdd101 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939959424:0@lo:103: 00010000:00010000:3.0:1789427735.902330:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427735.902355:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902356:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427735.902361:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090dcf390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939959680:0@lo:103: 00010000:00010000:3.0:1789427735.902367:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000b81c9259/0x84fc867ede517e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517e5b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902368:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b29f95cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3614:x1876350939959552:12345-0@lo:103: 00010000:00010000:1.0:1789427735.902379:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427735.902384:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902385:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427735.902389:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427735.902394:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.902395:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427735.902396:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427735.902407:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b03714d/0x84fc867ede517e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517e38 expref: 12 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902446:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427735.902466:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959680 00000100:00100000:0.0:1789427735.902471:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959680 00010000:00010000:0.0:1789427735.902488:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 12 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902493:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b29f95cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3614:x1876350939959552:12345-0@lo:103: Request processed in 127us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.902501:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f727881 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939959552:0@lo:103: 00000100:00100000:1.0:1789427735.902505:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427735.902525:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427735.902531:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006d1414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:3614:x1876350939959680:12345-0@lo:103: 00010000:00010000:1.0:1789427735.902536:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427735.902539:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 11 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902545:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 11 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902551:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000562b9e3d/0x84fc867ede517e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517e54 expref: 11 pid: 6478 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902562:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902567:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902574:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902577:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902581:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902585:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902587:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7c80bcb already unused, calling callback (000000002c5e5a21) 00010000:00010000:1.0:1789427735.902589:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902593:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902603:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.902608:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427735.902623:0:6477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902632:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006d1414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:3614:x1876350939959680:12345-0@lo:103: Request processed in 101us (239us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427735.902633:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.902647:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789427735.902648:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517f0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.902664:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090dcf390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939959680:0@lo:103: 20000000:01000000:0.0:1789427735.902665:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789427735.903759:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d103d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:7412:x1876350939958912:12345-0@lo:253: Request processed in 11523us (11634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.903767:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427735.903790:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939958912:0@lo:253: 10000000:01000000:3.0:1789427735.903801:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789427735.903804:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789427735.903805:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789427735.903807:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427735.903808:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1789427735.903810:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427735.903811:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427735.903812:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789427735.903813:0:7412:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789427735.903815:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427735.903816:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789427735.903829:0:7412:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002065787a from lustre-MDT0001 10000000:01000000:3.0:1789427735.903854:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789427735.903857:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789427735.903862:0:7412:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688454d40 local copy 10000000:01000000:3.0:1789427735.903864:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789427735.903881:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.903889:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.903896:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427735.903909:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939959808:0@lo:101: 00000100:00100000:3.0:1789427735.903934:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427735.903959:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e96bbe1a going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.903977:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959808 00000100:00100000:2.0:1789427735.903982:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959808 00000100:00100000:2.0:1789427735.904008:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427735.904013:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a00985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+9:7412:x1876350939959808:12345-0@lo:101: 00010000:00010000:2.0:1789427735.904021:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427735.904028:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097374c8b/0x84fc867ede517f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517f11 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.904048:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097374c8b/0x84fc867ede517f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517f11 expref: 10 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.904054:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097374c8b/0x84fc867ede517f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f11 expref: 10 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.904061:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097374c8b, rc 0) 00000100:00100000:2.0:1789427735.904094:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a00985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:7412:x1876350939959808:12345-0@lo:101: Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.904101:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789427735.904125:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939959808:0@lo:101: 00010000:00010000:3.0:1789427735.904134:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904140:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427735.904203:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939959936:0@lo:501: 00000100:00100000:3.0:1789427735.904227:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427735.904241:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e96bbe1a going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.904261:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939959936 00000100:00100000:0.0:1789427735.904266:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939959936 00000100:00100000:0.0:1789427735.904293:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427735.904299:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000615b6772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:7412:x1876350939959936:12345-0@lo:501: 00000100:00100000:0.0:1789427735.904352:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000615b6772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:7412:x1876350939959936:12345-0@lo:501: Request processed in 54us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427735.904360:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789427735.904370:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939959936:0@lo:501: 10000000:01000000:3.0:1789427735.904381:0:7412:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789427735.904394:0:7412:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789427735.904396:0:7412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904401:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904404:0:7412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904428:0:7412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789427735.904459:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427735.904464:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.904469:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196adadd000 10000000:01000000:3.0:1789427735.904475:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789427735.904481:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff919688454d40 10000000:01000000:3.0:1789427735.904487:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789427735.904487:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000609d77c5 already unused, calling callback (00000000cd629de8) 10000000:00010000:0.0:1789427735.904491:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.904493:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff919688454d40 from 1 10000000:01000000:3.0:1789427735.904498:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789427735.904502:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427735.904509:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904514:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427735.904515:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789427735.904525:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.904531:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904533:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.904548:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789427735.904556:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960064:0@lo:101: 00010000:00010000:0.0:1789427735.904568:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.904576:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000609d77c5/0x84fc867ede517f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede517f18 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.904578:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d05ac41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939960192:0@lo:103: 00000100:00100000:3.0:1789427735.904581:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.904603:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960064 00010000:00010000:0.0:1789427735.904607:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427735.904610:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960064 00010000:00010000:0.0:1789427735.904611:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427735.904613:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cd49e50 going to sleep for 11 seconds 00010000:00010000:0.0:1789427735.904615:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427735.904620:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.904645:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427735.904646:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960192 00000100:00100000:0.0:1789427735.904651:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960192 00000100:00100000:2.0:1789427735.904658:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce97b0fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:7412:x1876350939960064:12345-0@lo:101: 00010000:00010000:2.0:1789427735.904665:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427735.904673:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bdd3fb4f/0x84fc867ede517f26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517f1f expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.904686:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789427735.904689:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdd3fb4f/0x84fc867ede517f26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517f1f expref: 12 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427735.904697:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000593e23ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3615:x1876350939960192:12345-0@lo:103: 00010000:00010000:2.0:1789427735.904701:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bdd3fb4f/0x84fc867ede517f26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f1f expref: 12 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.904706:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427735.904710:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bdd3fb4f, rc 0) 00010000:00010000:0.0:1789427735.904721:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000097374c8b/0x84fc867ede517f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede517f11 expref: 12 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.904734:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427735.904750:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce97b0fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:7412:x1876350939960064:12345-0@lo:101: Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.904758:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789427735.904770:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960064:0@lo:101: 00000100:00100000:0.0:1789427735.904776:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000593e23ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:3615:x1876350939960192:12345-0@lo:103: Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.904784:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789427735.904786:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.904792:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d05ac41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939960192:0@lo:103: 00010000:00010000:3.0:1789427735.904800:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.904816:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789427735.904827:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904843:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 000000009e3586db/0x84fc867ede517f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.904856:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9196adadd000 10000000:01000000:3.0:1789427735.904860:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789427735.904863:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9196adadd000 from 1 10000000:01000000:3.0:1789427735.904865:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789427735.904877:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904883:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.904889:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427735.904900:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960320:0@lo:101: 00000100:00100000:3.0:1789427735.904923:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427735.904935:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cd49e50 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.904959:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960320 00000100:00100000:0.0:1789427735.904963:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960320 00000100:00100000:0.0:1789427735.904985:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789427735.904990:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000973767cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+10:7412:x1876350939960320:12345-0@lo:101: 00010000:00010000:0.0:1789427735.904997:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427735.905004:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082bd7b94/0x84fc867ede517f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517f2d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905017:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082bd7b94/0x84fc867ede517f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517f2d expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905024:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082bd7b94/0x84fc867ede517f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f2d expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905030:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082bd7b94, rc 0) 00000100:00100000:0.0:1789427735.905071:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000973767cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:7412:x1876350939960320:12345-0@lo:101: Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.905076:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789427735.905375:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960320:0@lo:101: 00010000:00010000:3.0:1789427735.905382:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.905386:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.905392:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789427735.905399:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.905403:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 000000009e13b06e/0x84fc867ede517f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427735.905431:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789427735.905434:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427735.905437:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9196adadd000 10000000:01000000:3.0:1789427735.905440:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789427735.905442:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789427735.905444:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789427735.905469:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.905474:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427735.905478:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427735.905485:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960448:0@lo:101: 00000100:00100000:3.0:1789427735.905507:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427735.905531:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cd49e50 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.905541:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960448 00000100:00100000:0.0:1789427735.905550:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960448 00000100:00100000:0.0:1789427735.905572:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427735.905578:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000adcaebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:7412:x1876350939960448:12345-0@lo:101: 00010000:00010000:0.0:1789427735.905600:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427735.905607:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004123f538/0x84fc867ede517f42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517f3b expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905617:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004123f538/0x84fc867ede517f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517f3b expref: 12 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905623:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004123f538/0x84fc867ede517f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f3b expref: 12 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.905627:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004123f538, rc 0) 00000100:00100000:0.0:1789427735.905659:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000adcaebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960448:12345-0@lo:101: Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.905665:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427735.905687:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785a8c9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960448:0@lo:101: 00010000:00010000:1.0:1789427735.905698:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.905704:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.905751:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960576:0@lo:501: 00000100:00100000:1.0:1789427735.905770:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.905782:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ab5e94 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.905788:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960576 00000100:00100000:0.0:1789427735.905792:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960576 00000100:00100000:0.0:1789427735.905816:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427735.905821:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066e15ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960576:12345-0@lo:501: 00000100:00100000:0.0:1789427735.905885:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066e15ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960576:12345-0@lo:501: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.905890:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789427735.905892:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960576:0@lo:501: 00000100:00100000:1.0:1789427735.905913:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960704:0@lo:503: 00000100:00100000:1.0:1789427735.905938:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.905950:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ab5e94 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.905960:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960704 00000100:00100000:0.0:1789427735.905963:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960704 00000100:00100000:0.0:1789427735.905980:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427735.905983:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dcb27fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960704:12345-0@lo:503: 00000100:00100000:0.0:1789427735.906059:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dcb27fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960704:12345-0@lo:503: Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.906064:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789427735.906072:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960704:0@lo:503: 00000040:00080000:1.0:1789427735.906246:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427735.906296:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960832:0@lo:502: 00000100:00100000:1.0:1789427735.906317:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.906330:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ab5e94 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.906343:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960832 00000100:00100000:0.0:1789427735.906347:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960832 00000100:00100000:0.0:1789427735.906370:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789427735.906377:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f92bbaa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960832:12345-0@lo:502: 00000100:00100000:0.0:1789427735.906497:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f92bbaa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960832:12345-0@lo:502: Request processed in 121us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427735.906503:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960832:0@lo:502: 00000100:00100000:0.0:1789427735.906505:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:1.0:1789427735.906667:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789427735.906691:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1789427735.906704:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1789427735.906718:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1789427735.906731:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1789427735.906743:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1789427735.906755:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1789427735.906763:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1789427735.906769:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1789427735.906776:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1789427735.906782:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1789427735.906789:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1789427735.906805:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1789427735.906812:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1789427735.906818:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1789427735.906825:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1789427735.906831:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1789427735.906837:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1789427735.906848:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1789427735.906860:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1789427735.906872:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1789427735.906885:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1789427735.906898:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1789427735.906912:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960960:0@lo:502: 00000100:00100000:1.0:1789427735.906934:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.906954:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ab5e94 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.906968:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939960960 00000100:00100000:0.0:1789427735.906974:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939960960 00000100:00100000:0.0:1789427735.907001:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789427735.907009:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010eefe2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960960:12345-0@lo:502: 00000100:00100000:0.0:1789427735.907085:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010eefe2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939960960:12345-0@lo:502: Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.907090:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789427735.907101:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c55e9643 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939960960:0@lo:502: 00000040:00080000:1.0:1789427735.907130:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1789427735.907135:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1789427735.907367:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427735.907375:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427735.907376:0:7425:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789427735.907380:0:7425:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789427735.907382:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427735.907391:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000012099c51) 00000020:00000080:3.0:1789427735.907402:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789427735.907405:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789427735.907525:0:7425:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789427735.907530:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede517f50 00000020:00000080:3.0:1789427735.907694:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789427735.907700:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427735.907702:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427735.907703:0:7425:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789427735.907704:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427735.907707:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427735.907708:0:7425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789427735.907709:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427735.907714:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a9951bd9) 00000020:00000080:3.0:1789427735.907720:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789427735.907723:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789427735.907724:0:7425:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789427735.907725:0:7425:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789427735.907729:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789427735.907763:0:7425:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002065787a from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789427735.907774:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000049eae82c) 00000020:00000080:3.0:1789427735.907780:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789427735.907814:0:7425:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789427735.907818:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede517f65 00000020:00000080:3.0:1789427735.907884:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789427735.907888:0:7425:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789427735.907891:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x84fc867ede517f6c 00080000:01000000:3.0:1789427735.907894:0:7425:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789427735.907895:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede517f73 00080000:10000000:3.0:1789427735.908112:0:7425:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789427735.908239:0:7425:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789427735.943022:0:7425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789427735.943228:0:7425:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789427735.944485:0:7425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789427735.944630:0:7425:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789427735.948253:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789427735.948267:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427735.948271:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427735.948273:0:7425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789427735.948278:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427735.948282:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427735.948283:0:7425:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789427735.948285:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789427735.948289:0:7425:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:1.0:1789427735.948310:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427735.948320:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000861b7dc0) 00000020:00000080:1.0:1789427735.948335:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789427735.948340:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789427735.948411:0:7425:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789427735.948438:0:7425:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789427735.948447:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede517f81 00010000:00080000:1.0:1789427735.948490:0:7425:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b12c1df@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789427735.949854:0:7425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789427735.950461:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789427735.950469:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789427735.950509:0:7425:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789427735.950523:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede517f88 00000100:00080000:2.0:1789427735.950531:0:7425:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427735.950537:0:7425:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000003b12c1df using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427735.950567:0:7425:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024406195 x1876350939961088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427735.950587:0:7425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789427735.950604:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024406195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939961088:0@lo:38: 00000020:01000000:2.0:1789427735.950642:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427735.950646:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427735.950648:0:7425:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789427735.950651:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789427735.950654:0:7425:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789427735.950661:0:7425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789427735.950663:0:7425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789427735.950665:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789427735.950667:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789427735.950667:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789427735.950668:0:7425:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789427735.950671:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427735.950675:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1789427735.950678:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350939961216:0@lo:400: 00000020:00000080:2.0:1789427735.950678:0:7425:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:2.0:1789427735.950701:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961088 00000100:00100000:2.0:1789427735.950707:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961088 00000100:00100000:2.0:1789427735.950738:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427735.950744:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c55e9643 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350939961088:12345-0@lo:38: 00010000:00080000:2.0:1789427735.950764:0:6487:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 80 last 0 00000020:00000080:2.0:1789427735.950785:0:6487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede517f8f 00000004:00100000:2.0:1789427735.950796:0:6487:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789427735.950800:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:2.0:1789427735.950848:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789427735.950878:0:7425:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789427735.950892:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427735.950894:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427735.950896:0:7425:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789427735.950898:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427735.950900:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427735.950901:0:7425:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789427735.950904:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789427735.950905:0:7425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789427735.950921:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427735.950922:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427735.950923:0:7425:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789427735.950925:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1789427735.950980:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789427735.951004:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789427735.951019:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.951031:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 000000000a4f1112/0x84fc867ede517f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427735.951039:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196adadd000 from 1 10000000:01000000:1.0:1789427735.951042:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427735.951063:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427735.951292:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.951341:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961216 00000100:00100000:2.0:1789427735.951348:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961216 00000100:00100000:2.0:1789427735.951401:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427735.951411:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e0eb4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350939961216:12345-0@lo:400: 00000100:00100000:2.0:1789427735.951516:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e0eb4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350939961216:12345-0@lo:400: Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.951526:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789427735.951549:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c2b887d x1876350939961216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427735.951563:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350939961216:0@lo:400: 00010000:00010000:1.0:1789427735.951646:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.951652:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.951663:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961344:0@lo:101: 00000100:00100000:1.0:1789427735.951687:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.951721:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e087ea5a going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.951723:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961344 00000100:00100000:2.0:1789427735.951728:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961344 00000100:00100000:2.0:1789427735.951762:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427735.951770:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087c60963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:7412:x1876350939961344:12345-0@lo:101: 00010000:00010000:2.0:1789427735.951779:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427735.951789:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517f96 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.951808:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517f96 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.951817:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f96 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.951825:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092a1659d, rc 0) 00000100:00100000:2.0:1789427735.951860:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087c60963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:7412:x1876350939961344:12345-0@lo:101: Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.951866:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789427735.951890:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961344:0@lo:101: 00010000:00010000:1.0:1789427735.951902:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.951910:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.952391:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961472:0@lo:256: 00000100:00100000:1.0:1789427735.952460:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427735.952485:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961472 00000100:00100000:0.0:1789427735.952490:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961472 00000100:00100000:1.0:1789427735.952496:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e087ea5a going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.952523:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427735.952529:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca99a6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:7412:x1876350939961472:12345-0@lo:256: 20000000:01000000:0.0:1789427735.952540:0:6475:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789427735.952552:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789427735.952555:0:6475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789427735.952628:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca99a6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:7412:x1876350939961472:12345-0@lo:256: Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.952634:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789427735.952651:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961472:0@lo:256: 10000000:01000000:1.0:1789427735.953093:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427735.953104:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.953109:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427735.953121:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196adadd000 from 1 10000000:01000000:1.0:1789427735.953123:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427735.953135:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.953140:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.953147:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.953157:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961600:0@lo:101: 00000100:00100000:1.0:1789427735.953183:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.953203:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e087ea5a going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.953215:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961600 00000100:00100000:0.0:1789427735.953219:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961600 00000100:00100000:0.0:1789427735.953244:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427735.953250:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006821d01f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:7412:x1876350939961600:12345-0@lo:101: 00010000:00010000:0.0:1789427735.953261:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427735.953268:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517fa4 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.953279:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.953285:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.953289:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7c80bcb, rc 0) 00000100:00100000:0.0:1789427735.953317:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006821d01f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939961600:12345-0@lo:101: Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.953323:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789427735.953333:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961600:0@lo:101: 00000100:00080000:2.0:1789427735.953339:0:6487:0:(import.c:65:import_set_state_nolock()) 00000000ae83f98a : changing import state from RECOVER to FULL 00010000:00010000:1.0:1789427735.953344:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.953350:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.953383:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c55e9643 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350939961088:12345-0@lo:38: Request processed in 2636us (2716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.953392:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427735.953394:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789427735.953400:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1789427735.953406:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961728:0@lo:501: 00000100:00080000:0.0:1789427735.953406:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789427735.953411:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789427735.953430:0:3612:0:(import.c:65:import_set_state_nolock()) 000000003b12c1df lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789427735.953446:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024406195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939961088:0@lo:38: 00000100:00100000:1.0:1789427735.953467:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427735.953491:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961728 00000100:00100000:0.0:1789427735.953495:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961728 00000100:00100000:1.0:1789427735.953504:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e087ea5a going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.953506:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac881ed1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939961856:0@lo:41: 00000100:00100000:0.0:1789427735.953524:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427735.953532:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000782b8377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939961728:12345-0@lo:501: 00000100:00100000:2.0:1789427735.953539:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.953577:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961856 00000100:00100000:1.0:1789427735.953582:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961856 00000100:00100000:1.0:1789427735.953617:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427735.953621:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000782b8377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939961728:12345-0@lo:501: Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427735.953628:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000037edaa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1876350939961856:12345-0@lo:41: 00000100:00100000:0.0:1789427735.953631:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789427735.953641:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961728:0@lo:501: 00000004:00000024:1.0:1789427735.953655:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789427735.953678:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e14377d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961984:0@lo:503: 00000100:00100000:1.0:1789427735.953700:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000037edaa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1876350939961856:12345-0@lo:41: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427735.953709:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427735.953717:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.953726:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac881ed1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939961856:0@lo:41: 00000100:00100000:3.0:1789427735.953741:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d86d58c going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.953750:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939961984 00000100:00100000:0.0:1789427735.953754:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939961984 00000100:00100000:0.0:1789427735.953778:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427735.953785:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000984800a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939961984:12345-0@lo:503: 00000040:00080000:0.0:1789427735.953808:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789427735.953841:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000984800a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939961984:12345-0@lo:503: Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.953847:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789427735.953857:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e14377d pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939961984:0@lo:503: 00000040:00080000:3.0:1789427735.954019:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427735.954056:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789427735.954110:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427735.954655:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789427735.954704:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789427735.954722:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427735.954733:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.954741:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427735.954777:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789427735.954780:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196adadd000 10000000:01000000:1.0:1789427735.954783:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196adadd000 10000000:01000000:1.0:1789427735.954787:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427735.954791:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196adadd000 from 1 10000000:01000000:1.0:1789427735.954793:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789427735.954806:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.954812:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.954819:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.954829:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962112:0@lo:101: 00000100:00100000:1.0:1789427735.954853:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.954884:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe84532e going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.954888:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962112 00000100:00100000:0.0:1789427735.954894:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962112 00000100:00100000:0.0:1789427735.954924:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427735.954930:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e518857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:7412:x1876350939962112:12345-0@lo:101: 00010000:00010000:0.0:1789427735.954937:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427735.954953:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010fde08f/0x84fc867ede517fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517fb2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.954966:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010fde08f/0x84fc867ede517fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.954974:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010fde08f/0x84fc867ede517fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427735.954980:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010fde08f, rc 0) 00000100:00100000:0.0:1789427735.955009:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e518857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962112:12345-0@lo:101: Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.955013:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789427735.955050:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962112:0@lo:101: 00010000:00010000:1.0:1789427735.955061:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.955067:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.955122:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962240:0@lo:501: 00000100:00100000:1.0:1789427735.955147:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.955171:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe84532e going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.955184:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962240 00000100:00100000:0.0:1789427735.955189:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962240 00000100:00100000:0.0:1789427735.955213:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789427735.955217:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ae1a7d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962240:12345-0@lo:501: 00000100:00100000:0.0:1789427735.955273:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ae1a7d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962240:12345-0@lo:501: Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.955277:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427735.955299:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962240:0@lo:501: 00000100:00100000:1.0:1789427735.955321:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962368:0@lo:503: 00000100:00100000:1.0:1789427735.955345:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.955357:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe84532e going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.955373:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962368 00000100:00100000:0.0:1789427735.955377:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962368 00000100:00100000:0.0:1789427735.955400:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789427735.955406:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d11328b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962368:12345-0@lo:503: 00000100:00100000:0.0:1789427735.955493:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d11328b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962368:12345-0@lo:503: Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.955498:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789427735.955513:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962368:0@lo:503: 00000040:00080000:1.0:1789427735.955628:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427735.955681:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962496:0@lo:502: 00000100:00100000:1.0:1789427735.955705:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.955721:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000009af2f3b4 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.955730:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962496 00000100:00100000:0.0:1789427735.955734:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962496 00000100:00100000:0.0:1789427735.955754:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427735.955757:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073569207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962496:12345-0@lo:502: 00000100:00100000:0.0:1789427735.955822:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073569207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962496:12345-0@lo:502: Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.955826:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789427735.955840:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962496:0@lo:502: 00000040:00080000:1.0:1789427735.955940:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789427735.955956:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789427735.955963:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789427735.955969:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789427735.955975:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789427735.955981:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789427735.955994:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789427735.956000:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789427735.956007:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789427735.956013:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789427735.956020:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789427735.956027:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789427735.956038:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789427735.956052:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789427735.956065:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789427735.956077:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789427735.956100:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789427735.956113:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789427735.956124:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789427735.956134:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789427735.956145:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789427735.956156:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789427735.956167:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789427735.956179:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789427735.956189:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789427735.956199:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789427735.956209:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789427735.956219:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789427735.956235:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962624:0@lo:502: 00000100:00100000:1.0:1789427735.956259:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.956271:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000009af2f3b4 going to sleep for 11 seconds 00000100:00100000:0.0:1789427735.956285:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962624 00000100:00100000:0.0:1789427735.956289:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962624 00000100:00100000:0.0:1789427735.956308:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427735.956311:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000928b4ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962624:12345-0@lo:502: 00000100:00100000:0.0:1789427735.956358:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000928b4ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962624:12345-0@lo:502: Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427735.956362:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427735.956375:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5ed25d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962624:0@lo:502: 00000040:00080000:1.0:1789427735.956403:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789427735.956408:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789427735.956656:0:7431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789427735.956665:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007ed4d25c) 00000020:00000080:2.0:1789427735.956675:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789427735.956730:0:7431:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002065787a from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789427735.956733:0:7431:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002065787a from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789427735.956735:0:7431:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002065787a 3 00010000:00080000:2.0:1789427735.956758:0:7431:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001da69c20@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789427735.957862:0:7431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789427735.958004:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789427735.958031:0:7431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789427735.958040:0:7431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x84fc867ede517fc7 00000100:00080000:2.0:1789427735.958045:0:7431:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427735.958050:0:7431:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000001da69c20 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427735.958066:0:7431:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ac881ed1 x1876350939962752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427735.958082:0:7431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789427735.958118:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac881ed1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350939962752:0@lo:38: 00000100:00100000:1.0:1789427735.958159:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.958210:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962752 00000100:00100000:2.0:1789427735.958216:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962752 00000100:00100000:2.0:1789427735.958241:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427735.958246:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ed25d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350939962752:12345-0@lo:38: 00010000:00080000:2.0:1789427735.958261:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 80 last 0 00000020:00000080:2.0:1789427735.958288:0:6484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x84fc867ede517fce 00000004:00100000:2.0:1789427735.958299:0:6484:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789427735.958317:0:6484:0:(import.c:65:import_set_state_nolock()) 000000005d1d2101 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427735.958354:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ed25d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3612:x1876350939962752:12345-0@lo:38: Request processed in 108us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.958373:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789427735.958393:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ac881ed1 x1876350939962752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427735.958404:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427735.958409:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789427735.958438:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789427735.958443:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789427735.958445:0:3612:0:(import.c:65:import_set_state_nolock()) 000000001da69c20 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427735.958466:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac881ed1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350939962752:0@lo:38: 40000000:00080000:3.0:1789427735.958541:0:7432:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:2.0:1789427735.958625:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789427735.958686:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789427735.958706:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427735.958719:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.958728:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000bea868ff/0x84fc867ede517fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789427735.958766:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789427735.958769:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789427735.958770:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427735.958772:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427735.958773:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427735.958774:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427735.958775:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427735.958777:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427735.958778:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427735.958779:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427735.958781:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427735.958784:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789427735.958786:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427735.958788:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789427735.958789:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427735.958790:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427735.958796:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427735.958798:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427735.958798:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427735.958799:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427735.958800:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427735.958801:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427735.958801:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427735.958814:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789427735.958821:0:7412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003342ad2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962880:0@lo:253: 00000100:00100000:1.0:1789427735.958851:0:7412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.958869:0:7412:0:(client.c:2716:ptlrpc_set_wait()) set 000000009af2f3b4 going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.958886:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939962880 00000100:00100000:2.0:1789427735.958890:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939962880 00000100:00100000:2.0:1789427735.958917:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427735.958931:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3aed0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962880:12345-0@lo:253: 20000000:01000000:2.0:1789427735.958950:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789427735.958961:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789427735.959750:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789427735.959790:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789427735.959802:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789427735.959819:0:6498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789427735.959824:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789427735.959838:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959849:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517eee expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959855:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f96 expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959861:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959881:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959892:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 15 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.959902:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9ce8722 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939963008:0@lo:104: 00000100:00100000:1.0:1789427735.959943:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.959951:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3aed0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:7412:x1876350939962880:12345-0@lo:253: Request processed in 1021us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.959958:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789427735.959975:0:7412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003342ad2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:7412:1876350939962880:0@lo:253: 10000000:01000000:0.0:1789427735.959986:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00010000:00010000:1.0:1789427735.959987:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.959994:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 14 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427735.959996:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789427735.959999:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789427735.960002:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427735.960004:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427735.960005:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1789427735.960007:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d6b78b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939963136:0@lo:104: 00000020:01000004:0.0:1789427735.960008:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427735.960010:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427735.960012:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427735.960014:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427735.960014:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427735.960015:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789427735.960022:0:7412:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789427735.960032:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.960052:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b27dfe4d going to sleep for 11 seconds 00000100:00100000:1.0:1789427735.960073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963008 00000100:00100000:1.0:1789427735.960077:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963008 00000100:00100000:1.0:1789427735.960105:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963136 00000100:00100000:1.0:1789427735.960107:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963136 00000100:00100000:2.0:1789427735.960113:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427735.960121:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008d059a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939963008:12345-0@lo:104: 00000100:00100000:1.0:1789427735.960126:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789427735.960129:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.960136:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012e46cf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939963136:12345-0@lo:104: 00010000:00010000:1.0:1789427735.960146:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.960172:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789427735.960176:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008d059a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939963008:12345-0@lo:104: Request processed in 57us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.960181:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789427735.960190:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789427735.960197:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012e46cf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939963136:12345-0@lo:104: Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427735.960203:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789427735.960226:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427735.960232:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960238:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000099768912 already unused, calling callback (00000000cd629de8) 10000000:00010000:1.0:1789427735.960241:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960253:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427735.960260:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427735.960265:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427735.960290:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960295:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427735.960309:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960313:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d3c3e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939963264:0@lo:103: 00010000:00010000:1.0:1789427735.960315:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 0000000099768912/0x84fc867ede517f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f9d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960328:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427735.960330:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960334:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c636f4f3 already unused, calling callback (00000000cd629de8) 10000000:00010000:1.0:1789427735.960336:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960340:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960345:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789427735.960350:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427735.960358:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427735.960376:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960380:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427735.960395:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960399:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f154bc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939963392:0@lo:103: 00010000:00010000:1.0:1789427735.960400:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000c636f4f3/0x84fc867ede517eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ef5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960441:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427735.960441:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427735.960445:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427735.960457:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427735.960483:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963264 00000100:00100000:1.0:1789427735.960487:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963264 00010000:00010000:1.0:1789427735.960501:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 15 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.960521:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963392 00000100:00100000:1.0:1789427735.960522:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963392 00010000:00010000:1.0:1789427735.960534:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 16 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960535:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427735.960548:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb152ee6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3614:x1876350939963264:12345-0@lo:103: 00000100:00100000:1.0:1789427735.960556:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789427735.960557:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427735.960562:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 16 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.960565:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a412725a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3615:x1876350939963392:12345-0@lo:103: 00010000:00010000:1.0:1789427735.960575:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427735.960578:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 16 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960581:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 16 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427735.960597:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427735.960603:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 16 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960614:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960618:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960625:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb152ee6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3614:x1876350939963264:12345-0@lo:103: Request processed in 79us (283us total) trans 0 rc 0/0 20000000:01000000:1.0:1789427735.960626:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000964032s 00010000:00010000:1.0:1789427735.960630:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789427735.960641:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960646:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960649:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960653:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b81c9259 already unused, calling callback (000000002c5e5a21) 00010000:00010000:1.0:1789427735.960655:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960659:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427735.960661:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d3c3e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939963264:0@lo:103: 00010000:00010000:1.0:1789427735.960670:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960684:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427735.960708:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a412725a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3615:x1876350939963392:12345-0@lo:103: Request processed in 147us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427735.960713:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427735.960716:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f154bc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939963392:0@lo:103: 00010000:00010000:1.0:1789427735.960760:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092a1659d/0x84fc867ede517f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517f96 expref: 14 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.960766:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9ce8722 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939963008:0@lo:104: 00010000:00010000:1.0:1789427735.960771:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000de8cb4a/0x84fc867ede517ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517eee expref: 13 pid: 6477 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427735.960775:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d6b78b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939963136:0@lo:104: 00010000:00010000:1.0:1789427735.960783:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960787:0:6498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960790:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.960793:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b81c9259/0x84fc867ede517fd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427735.961482:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789427735.962516:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789427735.962663:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789427735.962785:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789427735.962899:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789427735.963012:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789427735.963108:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789427735.963563:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789427735.963747:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789427735.963892:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789427735.964045:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789427735.964168:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789427735.964280:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1789427735.965127:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789427735.965130:0:7436:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789427735.965134:0:7436:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789427735.965275:0:7437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789427735.965289:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789427735.965308:0:7437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d6b78b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7437:1876350939963520:0@lo:700: 00000100:00100000:1.0:1789427735.965347:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.965377:0:7437:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a57e2b89 going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.965396:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963520 00000100:00100000:2.0:1789427735.965402:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963520 00000100:00100000:2.0:1789427735.965461:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427735.965471:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9ce8722 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7437:x1876350939963520:12345-0@lo:700: 00000100:00100000:1.0:1789427735.965522:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939963648:0@lo:1000: 00000100:00100000:1.0:1789427735.965553:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.965583:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963648 00000100:00100000:2.0:1789427735.965587:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963648 00000100:00100000:1.0:1789427735.965587:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c108e5df going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.965610:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427735.965617:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000593e23ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939963648:12345-0@lo:1000: 00000100:00100000:1.0:1789427735.965617:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789427735.965629:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789427735.965677:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000593e23ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939963648:12345-0@lo:1000: Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.965682:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427735.965705:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939963648:0@lo:1000: 00000040:01000000:0.0:1789427735.965713:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:01000000:1.0:1789427735.965738:0:7438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789427735.965762:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939963776:0@lo:700: 00000100:00100000:1.0:1789427735.965794:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.965814:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cdac5eb going to sleep for 11 seconds 00000100:00100000:3.0:1789427735.965826:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963776 00000100:00100000:3.0:1789427735.965832:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963776 00000040:00080000:0.0:1789427735.965841:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789427735.965865:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427735.965873:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1789427735.965874:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a136f48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939963776:12345-0@lo:700: 00000100:00100000:2.0:1789427735.965884:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:3.0:1789427735.965927:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a136f48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939963776:12345-0@lo:700: Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427735.965936:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427735.965952:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939963776:0@lo:700: 00000100:00100000:1.0:1789427735.965990:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7438:1876350939963904:0@lo:900: 00000100:00100000:1.0:1789427735.966014:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.966030:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cdac5eb going to sleep for 11 seconds 00000100:00100000:3.0:1789427735.966051:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939963904 00000100:00100000:3.0:1789427735.966060:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939963904 00000100:00100000:3.0:1789427735.966086:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427735.966093:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024810298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7438:x1876350939963904:12345-0@lo:900: 00000100:00100000:3.0:1789427735.966132:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024810298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7438:x1876350939963904:12345-0@lo:900: Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427735.966145:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789427735.966152:0:7438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b1a6783 x1876350939963904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789427751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427735.966163:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7438:1876350939963904:0@lo:900: 00000100:00100000:1.0:1789427735.966204:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964032:0@lo:1000: 00000100:00100000:1.0:1789427735.966226:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.966241:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fb78ca5 going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.966260:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964032 00000100:00100000:2.0:1789427735.966265:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964032 00000100:00100000:2.0:1789427735.966285:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427735.966290:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f154bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964032:12345-0@lo:1000: 00000004:00000080:0.0:1789427735.966302:0:7412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789427735.966311:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789427735.966337:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f154bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964032:12345-0@lo:1000: Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.966345:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427735.966355:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964032:0@lo:1000: 00000004:00080000:1.0:1789427735.966386:0:7438:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009cdac5eb with version 0 00000020:00100000:1.0:1789427735.966397:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789427735.966400:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009b1a6783 x1876350939964288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789427735.966407:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964288:0@lo:1000: 00000100:00100000:1.0:1789427735.966463:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.966483:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c9743e9 going to sleep for 11 seconds 00000040:00080000:0.0:1789427735.966488:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789427735.966495:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964288 00000100:00100000:2.0:1789427735.966499:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964288 00000100:00100000:2.0:1789427735.966520:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427735.966525:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d3c3e91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964288:12345-0@lo:1000: 00000001:00080000:1.0:1789427735.967374:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:3.0:1789427735.967442:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1789427735.967489:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d3c3e91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964288:12345-0@lo:1000: Request processed in 963us (1039us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789427735.967495:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789427735.967500:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789427735.967504:0:7438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789427735.967512:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964288:0@lo:1000: 00000040:00080000:0.0:1789427735.967512:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789427735.967554:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964416:0@lo:1000: 00000100:00100000:1.0:1789427735.967577:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427735.967596:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c108e5df going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.967603:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964416 00000100:00100000:2.0:1789427735.967607:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964416 00000100:00100000:2.0:1789427735.967627:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427735.967631:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003342ad2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964416:12345-0@lo:1000: 00000100:00100000:2.0:1789427735.967665:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003342ad2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1876350939964416:12345-0@lo:1000: Request processed in 34us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427735.967670:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427735.967684:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1876350939964416:0@lo:1000: 00000040:00080000:1.0:1789427735.967697:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789427735.967717:0:7438:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009cdac5eb with version 1 00000004:00080000:2.0:1789427735.967735:0:7428:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000e9573e1 version 1 rpc_version 1 00000020:00100000:2.0:1789427735.967747:0:7428:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789427735.967751:0:7428:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b0af5132 x1876350939964672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427735.967760:0:7428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7428:1876350939964672:0@lo:1000: 00000100:00100000:2.0:1789427735.967785:0:7428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427735.967799:0:7428:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053716ece going to sleep for 11 seconds 00000100:00100000:2.0:1789427735.967806:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964672 00000100:00100000:2.0:1789427735.967809:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964672 00000100:00100000:2.0:1789427735.967823:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427735.967826:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000815dde1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7428:x1876350939964672:12345-0@lo:1000: 00000001:00080000:2.0:1789427735.968459:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789427735.968491:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000815dde1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7428:x1876350939964672:12345-0@lo:1000: Request processed in 665us (706us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789427735.968496:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789427735.968511:0:7428:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789427735.968513:0:7428:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789427735.968518:0:7428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7428:1876350939964672:0@lo:1000: 00000040:00080000:0.0:1789427735.970511:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789427735.970554:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1789427735.970570:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9ce8722 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7437:x1876350939963520:12345-0@lo:700: Request processed in 5100us (5220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427735.970585:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789427735.970589:0:7437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000029d6b78b x1876350939963520/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789427751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427735.970600:0:7437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d6b78b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7437:1876350939963520:0@lo:700: 40000000:02000000:2.0:1789427735.970610:0:7437:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:0.0:1789427735.970691:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789427735.970864:0:7412:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789427735.971375:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789427735.971579:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:1.0:1789427735.971685:0:7438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00100000:10000000:0.0:1789427735.971712:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000004:00080000:1.0:1789427735.971717:0:7438:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789427735.971856:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789427735.972005:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789427735.972166:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789427735.972300:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789427735.972465:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789427735.972615:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789427735.972740:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789427735.972862:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789427735.972999:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789427735.973172:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789427735.973318:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789427735.974287:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789427735.974477:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789427735.974836:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789427735.975033:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789427735.975511:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789427735.975641:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000040:00080000:2.0:1789427735.975754:0:7437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789427735.975806:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789427735.975938:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789427735.976388:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789427735.976541:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789427735.976650:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789427735.976765:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789427735.976865:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789427735.976971:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789427735.977061:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789427735.977196:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789427735.977297:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789427735.977443:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789427735.977617:0:7412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789427735.978353:0:7412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789427735.978370:0:7412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb489c197b988 00100000:10000000:0.0:1789427735.978375:0:7412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:2.0:1789427735.978605:0:7437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000020:01000004:1.0:1789427735.978611:0:7412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789427735.978644:0:7412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000004:00080000:2.0:1789427735.978664:0:7437:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789427735.978669:0:7437:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:1.0:1789427735.978675:0:7412:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789427735.978688:0:7412:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789427735.979499:0:7412:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427735.979676:0:7412:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789427735.984568:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427737.008540:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427737.658972:0:7685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789427738.033860:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427738.175966:0:7737:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427738.176160:0:7737:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789427739.056628:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789427739.918997:0:7838:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427739.919118:0:7838:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789427740.080567:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427740.976664:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939964928:0@lo:41: 00000100:00100000:1.0:1789427740.976681:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adb9908a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939965184:0@lo:400: 00000100:00100000:0.0:1789427740.976681:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350939965056:0@lo:400: 00000100:00100000:2.0:1789427740.976728:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939964800:0@lo:400: 00000100:00100000:0.0:1789427740.976770:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427740.976776:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427740.976799:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427740.976852:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965184 00000100:00100000:0.0:1789427740.976858:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965056 00000100:00100000:3.0:1789427740.976864:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965184 00000100:00100000:0.0:1789427740.976866:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965056 00000100:00100000:1.0:1789427740.976885:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427740.976891:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964800 00000100:00100000:2.0:1789427740.976896:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964800 00000100:00100000:1.0:1789427740.976907:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350939965312:0@lo:400: 00000100:00100000:0.0:1789427740.976937:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427740.976948:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001aa370ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350939965056:12345-0@lo:400: 00000100:00100000:1.0:1789427740.976963:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427740.976967:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939964928 00000100:00100000:2.0:1789427740.976968:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789427740.976976:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939964928 00000100:00100000:2.0:1789427740.976985:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cf51fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:3613:x1876350939964800:12345-0@lo:400: 00000100:00100000:1.0:1789427740.977011:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427740.977021:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789427740.977022:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084f0da31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876350939965184:12345-0@lo:400: 00000100:00100000:0.0:1789427740.977032:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001aa370ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350939965056:12345-0@lo:400: Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427740.977054:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029d6b78b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350939964928:12345-0@lo:41: 00000100:00100000:0.0:1789427740.977055:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427740.977056:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cf51fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:3613:x1876350939964800:12345-0@lo:400: Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427740.977077:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084f0da31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876350939965184:12345-0@lo:400: Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427740.977081:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965312 00000100:00100000:2.0:1789427740.977082:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789427740.977086:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427740.977086:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965312 00000100:00100000:0.0:1789427740.977115:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427740.977122:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000337d9d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350939965312:12345-0@lo:400: 00000100:00100000:1.0:1789427740.977128:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adb9908a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939965184:0@lo:400: 00000004:00000024:3.0:1789427740.977139:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789427740.977141:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b1a6783 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939964800:0@lo:400: 00000100:00100000:0.0:1789427740.977167:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000337d9d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350939965312:12345-0@lo:400: Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427740.977173:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789427740.977181:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000466c3a03 x1876350939965056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427740.977190:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466c3a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350939965056:0@lo:400: 00010000:00080000:2.0:1789427740.977211:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f378fc0d x1876350939965312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427740.977224:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029d6b78b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939964928:12345-0@lo:41: Request processed in 182us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427740.977226:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f378fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350939965312:0@lo:400: 00000100:00100000:3.0:1789427740.977250:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427740.977266:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939964928:0@lo:41: 00010000:00010000:1.0:1789427741.105496:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427741.343327:0:7886:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcef683850 20000000:00000080:3.0:1789427741.343341:0:7886:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196b6277c00 uarg=0000000000000000 20000000:01000000:3.0:1789427741.343371:0:7886:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789427741.343377:0:7886:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789427741.343380:0:7886:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789427741.343549:0:7886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789427741.343559:0:7886:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789427741.345356:0:7886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427741.345579:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789427741.345608:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789427741.345625:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789427741.345636:0:7886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427741.345653:0:7886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.345668:0:7886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.345675:0:7886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.345681:0:7886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.345717:0:7886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.345728:0:7886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 12 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.345741:0:7886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e14377d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1876350939965440:0@lo:104: 00000100:00100000:3.0:1789427741.345799:0:7886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.345840:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789427741.345856:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965440 00010000:00010000:3.0:1789427741.345857:0:7886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.345863:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965440 00010000:00010000:3.0:1789427741.345868:0:7886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 12 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.345877:0:7886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007aa7c0cf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1876350939965568:0@lo:104: 00000100:00100000:3.0:1789427741.345896:0:7886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.345921:0:7886:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c16f411d going to sleep for 11 seconds 00000100:00100000:2.0:1789427741.345921:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965568 00000100:00100000:2.0:1789427741.345927:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965568 00000100:00100000:1.0:1789427741.345942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427741.345947:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789427741.345951:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000615a7907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:7886:x1876350939965440:12345-0@lo:104: 00000100:00100000:2.0:1789427741.345953:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057d5271d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:7886:x1876350939965568:12345-0@lo:104: 00010000:00010000:1.0:1789427741.345962:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.345963:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.346022:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789427741.346027:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000615a7907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:7886:x1876350939965440:12345-0@lo:104: Request processed in 78us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1789427741.346036:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789427741.346040:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057d5271d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:7886:x1876350939965568:12345-0@lo:104: Request processed in 88us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.346044:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427741.346047:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789427741.346053:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789427741.346063:0:7886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e14377d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1876350939965440:0@lo:104: 00010000:00010000:0.0:1789427741.346064:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346067:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427741.346074:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.346080:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9bd9257 already unused, calling callback (00000000cd629de8) 00000100:00100000:3.0:1789427741.346083:0:7886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007aa7c0cf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1876350939965568:0@lo:104: 00010000:00010000:2.0:1789427741.346086:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab1c9f31 already unused, calling callback (00000000cd629de8) 10000000:00010000:0.0:1789427741.346087:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427741.346097:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.346103:0:7886:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346107:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.346107:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427741.346130:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427741.346131:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427741.346143:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789427741.346151:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789427741.346175:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346182:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427741.346206:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346213:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517eb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ebd expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.346227:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939965696:0@lo:103: 00010000:00010000:2.0:1789427741.346227:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427741.346230:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427741.346233:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.346252:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427741.346267:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.346276:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789427741.346280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965696 00000100:00100000:3.0:1789427741.346281:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427741.346286:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965696 00000100:00100000:3.0:1789427741.346290:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed28e8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939965824:0@lo:103: 00010000:00010000:0.0:1789427741.346292:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.346301:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346306:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 13 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.346317:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.346331:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965824 00010000:00010000:0.0:1789427741.346334:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427741.346335:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965824 00010000:00010000:0.0:1789427741.346339:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.346344:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427741.346348:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.346351:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427741.346364:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007aa7c0cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:3613:x1876350939965696:12345-0@lo:103: 00010000:00010000:1.0:1789427741.346376:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789427741.346380:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789427741.346384:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.346386:0:6468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789427741.346388:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e14377d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:3613:x1876350939965824:12345-0@lo:103: 00000100:00100000:3.0:1789427741.346412:0:6468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789427741.346413:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427741.346436:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346447:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.346464:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346480:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7c80bcb/0x84fc867ede517fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517fa4 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.346485:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb50f008/0x84fc867ede517ebd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517eb6 expref: 14 pid: 6477 timeout: 235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346496:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346505:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.346513:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427741.346516:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346521:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346525:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346529:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346540:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000609d77c5 already unused, calling callback (000000002c5e5a21) 00010000:00010000:2.0:1789427741.346543:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346547:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.346553:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007aa7c0cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:3613:x1876350939965696:12345-0@lo:103: Request processed in 191us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.346562:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427741.346568:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0af5132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939965696:0@lo:103: 00010000:00010000:2.0:1789427741.346570:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.346574:0:7886:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.346587:0:7886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.346588:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427741.346593:0:7886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000609d77c5/0x84fc867ede517fdc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.346617:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e14377d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:3613:x1876350939965824:12345-0@lo:103: Request processed in 231us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.346623:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427741.346634:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed28e8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939965824:0@lo:103: 00010000:00010000:1.0:1789427742.128520:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427743.152598:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789427743.472495:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427743.472501:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196adadd000 from 4 10000000:01000000:1.0:1789427743.472505:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427743.472539:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.472548:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.472559:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.472601:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939965952:0@lo:101: 00000100:00100000:1.0:1789427743.472658:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.472710:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000265720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.472721:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939965952 00000100:00100000:2.0:1789427743.472729:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939965952 00000100:00100000:2.0:1789427743.472775:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427743.472782:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba72b490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+11:6481:x1876350939965952:12345-0@lo:101: 00010000:00010000:2.0:1789427743.472794:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427743.472804:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d60ae00/0x84fc867ede517fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517fe3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.472824:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d60ae00/0x84fc867ede517fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.472833:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d60ae00/0x84fc867ede517fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.472851:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d60ae00, rc 0) 00000100:00100000:2.0:1789427743.472894:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba72b490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939965952:12345-0@lo:101: Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.472901:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789427743.472930:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939965952:0@lo:101: 00010000:00010000:1.0:1789427743.472945:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.472953:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.472988:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966080:0@lo:256: 00000100:00100000:1.0:1789427743.473009:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.473021:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000265720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.473046:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966080 00000100:00100000:2.0:1789427743.473050:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966080 00000100:00100000:2.0:1789427743.473073:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789427743.473078:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e63277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939966080:12345-0@lo:256: 20000000:01000000:2.0:1789427743.473091:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789427743.473104:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789427743.473106:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789427743.473180:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e63277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939966080:12345-0@lo:256: Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.473188:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789427743.473197:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966080:0@lo:256: 10000000:01000000:1.0:1789427743.473232:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427743.473237:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.473242:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000e9bd9257/0x84fc867ede517fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.473248:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427743.473249:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196adadd000 from 1 10000000:01000000:1.0:1789427743.473250:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427743.473260:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.473271:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.473275:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.473282:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966208:0@lo:101: 00000100:00100000:1.0:1789427743.473300:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.473316:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000265720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.473335:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966208 00000100:00100000:2.0:1789427743.473340:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966208 00000100:00100000:2.0:1789427743.473361:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789427743.473367:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092f99f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+12:6481:x1876350939966208:12345-0@lo:101: 00010000:00010000:2.0:1789427743.473373:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427743.473392:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b03714d/0x84fc867ede517ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517ff1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.473404:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b03714d/0x84fc867ede517ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.473411:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b03714d/0x84fc867ede517ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427743.473447:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b03714d, rc 0) 00000100:00100000:2.0:1789427743.473474:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092f99f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966208:12345-0@lo:101: Request processed in 109us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.473480:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427743.473500:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966208:0@lo:101: 00010000:00010000:1.0:1789427743.473512:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.473519:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000ab1c9f31/0x84fc867ede517ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.473562:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966336:0@lo:501: 00000100:00100000:1.0:1789427743.473580:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.473597:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000265720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.473615:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966336 00000100:00100000:2.0:1789427743.473619:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966336 00000100:00100000:2.0:1789427743.473641:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427743.473646:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065c8e18e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966336:12345-0@lo:501: 00000100:00100000:2.0:1789427743.473737:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065c8e18e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966336:12345-0@lo:501: Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.473744:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427743.473770:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966336:0@lo:501: 00000100:00100000:1.0:1789427743.473793:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966464:0@lo:503: 00000100:00100000:1.0:1789427743.473820:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.473833:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000265720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.473854:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966464 00000100:00100000:2.0:1789427743.473858:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966464 00000100:00100000:2.0:1789427743.473879:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789427743.473884:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000c3b03d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966464:12345-0@lo:503: 00000100:00100000:2.0:1789427743.473951:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000c3b03d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966464:12345-0@lo:503: Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.473957:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789427743.473979:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dad9fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966464:0@lo:503: 00000100:00100000:2.0:1789427743.474208:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc58e829 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8102:1876350939966592:0@lo:502: 00000100:00100000:2.0:1789427743.474236:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.474251:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079ca803d going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.474273:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966592 00000100:00100000:3.0:1789427743.474279:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966592 00000100:00100000:3.0:1789427743.474308:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789427743.474316:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba8711fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8102:x1876350939966592:12345-0@lo:502: 00000100:00100000:3.0:1789427743.474395:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba8711fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8102:x1876350939966592:12345-0@lo:502: Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.474402:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789427743.474434:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc58e829 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8102:1876350939966592:0@lo:502: 00000020:01000000:2.0:1789427743.474458:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427743.474466:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427743.474468:0:8102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789427743.474479:0:8102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196adadd000 00000020:00000080:2.0:1789427743.474481:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789427743.474512:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8102:1876350939966720:0@lo:502: 00000100:00100000:2.0:1789427743.474537:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.474559:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.474580:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966720 00000100:00100000:0.0:1789427743.474584:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966720 00000100:00100000:0.0:1789427743.474606:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789427743.474612:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8102:x1876350939966720:12345-0@lo:502: 00000100:00100000:0.0:1789427743.474682:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8102:x1876350939966720:12345-0@lo:502: Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.474691:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8102:1876350939966720:0@lo:502: 00000100:00100000:0.0:1789427743.474692:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000020:01000000:2.0:1789427743.474714:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427743.474719:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427743.474721:0:8102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789427743.474725:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789427743.474792:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789427743.474818:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427743.474822:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.474828:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.474832:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789427743.474834:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919684ed8800 from 21 10000000:01000000:1.0:1789427743.474835:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789427743.474846:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.474852:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.474860:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.474871:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966848:0@lo:101: 00000100:00100000:1.0:1789427743.474896:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.474914:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.474936:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966848 00000100:00100000:3.0:1789427743.474940:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966848 00000100:00100000:3.0:1789427743.474960:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789427743.474966:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:6481:x1876350939966848:12345-0@lo:101: 00010000:00010000:3.0:1789427743.474971:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427743.474978:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede517fff expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.474988:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede517fff expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.474994:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fff expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.474998:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965000, rc 0) 00000100:00100000:3.0:1789427743.475029:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939966848:12345-0@lo:101: Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.475033:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789427743.475055:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966848:0@lo:101: 00010000:00010000:1.0:1789427743.475063:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.475069:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.475091:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966976:0@lo:501: 00000100:00100000:1.0:1789427743.475112:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.475125:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.475146:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939966976 00000100:00100000:0.0:1789427743.475150:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939966976 00000100:00100000:0.0:1789427743.475170:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789427743.475174:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939966976:12345-0@lo:501: 00000100:00100000:0.0:1789427743.475227:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939966976:12345-0@lo:501: Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.475232:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789427743.475254:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939966976:0@lo:501: 00000100:00100000:1.0:1789427743.475271:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967104:0@lo:503: 00000100:00100000:1.0:1789427743.475293:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.475306:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.475325:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967104 00000100:00100000:3.0:1789427743.475329:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967104 00000100:00100000:3.0:1789427743.475347:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789427743.475352:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939967104:12345-0@lo:503: 00000100:00100000:3.0:1789427743.475428:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939967104:12345-0@lo:503: Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.475435:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789427743.475440:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967104:0@lo:503: 00000100:00100000:3.0:1789427743.475619:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8103:1876350939967232:0@lo:502: 00000100:00100000:3.0:1789427743.475643:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.475661:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad9f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.475681:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967232 00000100:00100000:0.0:1789427743.475685:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967232 00000100:00100000:0.0:1789427743.475705:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789427743.475709:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8103:x1876350939967232:12345-0@lo:502: 00000100:00100000:0.0:1789427743.475762:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8103:x1876350939967232:12345-0@lo:502: Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.475766:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789427743.475787:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8103:1876350939967232:0@lo:502: 00000100:00100000:3.0:1789427743.475821:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8103:1876350939967360:0@lo:502: 00000100:00100000:3.0:1789427743.475842:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.475855:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad9f4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.475868:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967360 00000100:00100000:2.0:1789427743.475873:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967360 00000100:00100000:2.0:1789427743.475897:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789427743.475903:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8103:x1876350939967360:12345-0@lo:502: 00000100:00100000:2.0:1789427743.475967:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8103:x1876350939967360:12345-0@lo:502: Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.475974:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789427743.475989:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8103:1876350939967360:0@lo:502: 00000040:00080000:3.0:1789427743.476007:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789427743.476057:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789427743.476068:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427743.476072:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476078:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.476082:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427743.476083:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919684ed8800 from 4 10000000:01000000:1.0:1789427743.476084:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427743.476094:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476099:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476108:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.476117:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967488:0@lo:101: 00000100:00100000:1.0:1789427743.476150:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.476165:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.476183:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967488 00000100:00100000:0.0:1789427743.476187:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967488 00000100:00100000:0.0:1789427743.476206:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789427743.476211:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939967488:12345-0@lo:101: 00010000:00010000:0.0:1789427743.476215:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427743.476221:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51800d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476236:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51800d expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476241:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51800d expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476246:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208e00, rc 0) 00000100:00100000:0.0:1789427743.476269:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939967488:12345-0@lo:101: Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.476274:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789427743.476289:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967488:0@lo:101: 00010000:00010000:1.0:1789427743.476298:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476306:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.476343:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967616:0@lo:256: 00000100:00100000:1.0:1789427743.476394:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.476410:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.476431:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967616 00000100:00100000:2.0:1789427743.476436:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967616 00000100:00100000:2.0:1789427743.476463:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789427743.476470:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939967616:12345-0@lo:256: 20000000:01000000:2.0:1789427743.476480:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789427743.476489:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789427743.476492:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789427743.476552:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939967616:12345-0@lo:256: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.476560:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789427743.476572:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967616:0@lo:256: 10000000:01000000:1.0:1789427743.476606:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427743.476611:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476619:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.476625:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789427743.476627:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789427743.476630:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789427743.476642:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476649:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476662:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.476669:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967744:0@lo:101: 00000100:00100000:1.0:1789427743.476687:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.476711:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.476721:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967744 00000100:00100000:0.0:1789427743.476724:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967744 00000100:00100000:0.0:1789427743.476745:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427743.476749:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939967744:12345-0@lo:101: 00010000:00010000:0.0:1789427743.476754:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427743.476759:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51801b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476768:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51801b expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476772:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51801b expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427743.476777:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209e00, rc 0) 00000100:00100000:0.0:1789427743.476798:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939967744:12345-0@lo:101: Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.476803:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789427743.476818:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967744:0@lo:101: 00010000:00010000:1.0:1789427743.476829:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.476834:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.476864:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967872:0@lo:501: 00000100:00100000:1.0:1789427743.476887:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.476905:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939967872 00000100:00100000:1.0:1789427743.476908:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.476915:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939967872 00000100:00100000:2.0:1789427743.476942:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789427743.476948:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939967872:12345-0@lo:501: 00000100:00100000:2.0:1789427743.477007:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939967872:12345-0@lo:501: Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.477014:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789427743.477021:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939967872:0@lo:501: 00000100:00100000:1.0:1789427743.477040:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939968000:0@lo:503: 00000100:00100000:1.0:1789427743.477062:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.477074:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.477101:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968000 00000100:00100000:0.0:1789427743.477107:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968000 00000100:00100000:0.0:1789427743.477133:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789427743.477140:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939968000:12345-0@lo:503: 00000100:00100000:0.0:1789427743.477208:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939968000:12345-0@lo:503: Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.477216:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789427743.477234:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939968000:0@lo:503: 00000100:00100000:2.0:1789427743.477445:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8104:1876350939968128:0@lo:502: 00000100:00100000:2.0:1789427743.477474:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.477495:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.477507:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968128 00000100:00100000:3.0:1789427743.477512:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968128 00000100:00100000:3.0:1789427743.477534:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427743.477540:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8104:x1876350939968128:12345-0@lo:502: 00000100:00100000:3.0:1789427743.477613:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8104:x1876350939968128:12345-0@lo:502: Request processed in 73us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.477621:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789427743.477622:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8104:1876350939968128:0@lo:502: 00000020:01000000:2.0:1789427743.477646:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427743.477652:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427743.477654:0:8104:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789427743.477658:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789427743.477662:0:8104:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:2.0:1789427743.477679:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789427743.477691:0:8104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff919688450000) 00000020:00000080:2.0:1789427743.477705:0:8104:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789427743.477709:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789427743.477777:0:8104:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789427743.477781:0:8104:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789427743.477787:0:8104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede518030 00010000:00080000:2.0:1789427743.477809:0:8104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bc9ef800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789427743.479167:0:8104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789427743.479675:0:8104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427743.479680:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789427743.479702:0:8104:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789427743.479714:0:8104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede518037 00000100:00080000:2.0:1789427743.479720:0:8104:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427743.479731:0:8104:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bc9ef800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427743.479749:0:8104:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bbd70700 x1876350939968256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427743.479770:0:8104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789427743.479801:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939968256:0@lo:38: 00000040:01000000:2.0:1789427743.479803:0:8104:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1789427743.479839:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427743.479849:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939968512:0@lo:400: 00000100:00100000:2.0:1789427743.479872:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427743.479880:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350939968384:0@lo:400: 00000100:00100000:0.0:1789427743.479881:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.479885:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350939968640:0@lo:400: 00000100:00100000:1.0:1789427743.479895:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968256 00000100:00100000:1.0:1789427743.479899:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968256 00000100:00100000:2.0:1789427743.479926:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.479936:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968512 00000100:00100000:1.0:1789427743.479942:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968512 00000100:00100000:3.0:1789427743.479946:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789427743.479954:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350939968256:12345-0@lo:38: 00000100:00100000:2.0:1789427743.479968:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968640 00000100:00100000:2.0:1789427743.479973:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968640 00010000:00080000:3.0:1789427743.479977:0:6487:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 87 last 0 00000100:00100000:1.0:1789427743.479980:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427743.479991:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939968512:12345-0@lo:400: 00000100:00100000:2.0:1789427743.480011:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:3.0:1789427743.480015:0:6487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede51803e 00000100:00100000:0.0:1789427743.480018:0:6483:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789427743.480024:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350939968640:12345-0@lo:400: 00000004:00100000:3.0:1789427743.480029:0:6487:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789427743.480030:0:6483:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789427743.480035:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939968512:12345-0@lo:400: Request processed in 47us (155us total) trans 0 rc 0/0 00000001:00000004:3.0:1789427743.480038:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789427743.480043:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427743.480072:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939968512:0@lo:400: 00000100:00100000:2.0:1789427743.480076:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350939968640:12345-0@lo:400: Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.480084:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789427743.480104:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427743.480111:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196a980b800 x1876350939968640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427743.480124:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350939968640:0@lo:400: 00000100:00100000:2.0:1789427743.480128:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968384 00000100:00100000:2.0:1789427743.480133:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968384 00000100:00100000:2.0:1789427743.480160:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427743.480168:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350939968384:12345-0@lo:400: 00000100:00100000:2.0:1789427743.480206:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350939968384:12345-0@lo:400: Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.480213:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789427743.480249:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196a9809f80 x1876350939968384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427743.480257:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350939968384:0@lo:400: 00000100:00080000:1.0:1789427743.480288:0:8107:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9196bca2b100 x1876350939968768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427743.480295:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509e40 going to sleep for 0 seconds 00000020:01000000:0.0:1789427743.480314:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427743.480320:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427743.480322:0:8104:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789427743.480325:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427743.480330:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427743.480331:0:8104:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789427743.480336:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789427743.480338:0:8104:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789427743.480360:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8104:1876350939968896:0@lo:502: 00000100:00100000:0.0:1789427743.480437:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.480462:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968896 00000100:00100000:0.0:1789427743.480466:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.480467:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968896 00000100:00100000:2.0:1789427743.480490:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427743.480496:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8104:x1876350939968896:12345-0@lo:502: 00000100:00100000:2.0:1789427743.480571:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8104:x1876350939968896:12345-0@lo:502: Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.480582:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789427743.480600:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8104:1876350939968896:0@lo:502: 00000020:01000000:0.0:1789427743.480619:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427743.480624:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427743.480630:0:8104:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789427743.480633:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789427743.480693:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789427743.480711:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789427743.480717:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.480726:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.480732:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427743.480733:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919684ed8800 from 1 10000000:01000000:1.0:1789427743.480735:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427743.480747:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.480751:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.480756:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.480769:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969024:0@lo:101: 00000100:00100000:1.0:1789427743.480787:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.480800:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.480816:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969024 00000100:00100000:3.0:1789427743.480825:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969024 00000100:00100000:3.0:1789427743.480850:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427743.480855:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939969024:12345-0@lo:101: 00010000:00010000:3.0:1789427743.480860:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427743.480868:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518045 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.480880:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518045 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.480885:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518045 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.480890:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965600, rc 0) 00000100:00100000:3.0:1789427743.480915:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969024:12345-0@lo:101: Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.480919:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789427743.480947:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969024:0@lo:101: 00010000:00010000:1.0:1789427743.480958:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.480965:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.480990:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969152:0@lo:501: 00000100:00100000:1.0:1789427743.481008:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.481020:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.481038:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969152 00000100:00100000:2.0:1789427743.481042:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969152 00000100:00100000:2.0:1789427743.481066:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789427743.481073:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969152:12345-0@lo:501: 00000100:00100000:2.0:1789427743.481131:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969152:12345-0@lo:501: Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.481139:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789427743.481148:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969152:0@lo:501: 00000100:00100000:1.0:1789427743.481174:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969280:0@lo:503: 00000100:00100000:1.0:1789427743.481204:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.481218:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.481244:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969280 00000100:00100000:3.0:1789427743.481249:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969280 00000100:00100000:3.0:1789427743.481274:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789427743.481283:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969280:12345-0@lo:503: 00000100:00100000:3.0:1789427743.481353:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969280:12345-0@lo:503: Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.481361:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427743.481363:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969280:0@lo:503: 00000100:00100000:0.0:1789427743.481551:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8109:1876350939969408:0@lo:502: 00000100:00100000:0.0:1789427743.481591:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.481627:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969408 00000100:00100000:3.0:1789427743.481632:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969408 00000100:00100000:0.0:1789427743.481633:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.481665:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789427743.481675:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8109:x1876350939969408:12345-0@lo:502: 00000100:00100000:3.0:1789427743.481755:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8109:x1876350939969408:12345-0@lo:502: Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.481766:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8109:1876350939969408:0@lo:502: 00000100:00100000:3.0:1789427743.481771:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000020:01000000:0.0:1789427743.481789:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427743.481793:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427743.481794:0:8109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789427743.481800:0:8109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919684ed8800 00000020:00000080:0.0:1789427743.481802:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789427743.481818:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8109:1876350939969536:0@lo:502: 00000100:00100000:0.0:1789427743.481841:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427743.481853:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.481861:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969536 00000100:00100000:3.0:1789427743.481866:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969536 00000100:00100000:3.0:1789427743.481895:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789427743.481904:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8109:x1876350939969536:12345-0@lo:502: 00000100:00100000:3.0:1789427743.481969:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8109:x1876350939969536:12345-0@lo:502: Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.481976:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789427743.481977:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8109:1876350939969536:0@lo:502: 00000020:01000000:0.0:1789427743.481995:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427743.481998:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427743.482000:0:8109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789427743.482002:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789427743.482049:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789427743.482060:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427743.482063:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.482068:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427743.482085:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789427743.482087:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688454d40 from 1 10000000:01000000:1.0:1789427743.482089:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789427743.482104:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.482111:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.482118:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.482127:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969664:0@lo:101: 00000100:00100000:1.0:1789427743.482149:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.482166:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.482180:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969664 00000100:00100000:3.0:1789427743.482185:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969664 00000100:00100000:3.0:1789427743.482208:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789427743.482215:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939969664:12345-0@lo:101: 00010000:00010000:3.0:1789427743.482222:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427743.482230:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518053 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.482245:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518053 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.482253:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518053 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427743.482261:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964a00, rc 0) 00000100:00100000:3.0:1789427743.482295:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939969664:12345-0@lo:101: Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.482301:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789427743.482326:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969664:0@lo:101: 00010000:00010000:1.0:1789427743.482334:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.482339:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427743.482362:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969792:0@lo:501: 00000100:00100000:1.0:1789427743.482376:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427743.482401:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427743.482412:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969792 00000100:00100000:3.0:1789427743.482436:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969792 00000100:00100000:3.0:1789427743.482470:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789427743.482478:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939969792:12345-0@lo:501: 00000100:00100000:3.0:1789427743.482529:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939969792:12345-0@lo:501: Request processed in 52us (149us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789427743.482537:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427743.482548:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939969792:0@lo:501: 10000000:01000000:1.0:1789427743.482570:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789427743.482579:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427743.482583:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789427743.482739:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427743.482770:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350939968256:12345-0@lo:38: Request processed in 2816us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.482776:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427743.482788:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427743.482794:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789427743.482799:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789427743.482802:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789427743.482804:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9ef800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789427743.482814:0:3612:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000043f6841f): req@ffff9196bca2b100 x1876350939968768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427743.482840:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939968256:0@lo:38: 00000100:00100000:0.0:1789427743.482855:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427743.482864:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939969920:0@lo:41: 00000100:00100000:3.0:1789427743.482892:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427743.482925:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.482928:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.482930:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939968768 00000100:00100000:2.0:1789427743.482939:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939968768 00000100:00100000:1.0:1789427743.482954:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939969920 00000100:00100000:1.0:1789427743.482958:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939969920 00000100:00100000:2.0:1789427743.482966:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789427743.482974:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8107:x1876350939968768:12345-0@lo:1000: 00000100:00100000:0.0:1789427743.482979:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427743.482987:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3613:x1876350939969920:12345-0@lo:41: 00000004:00000024:0.0:1789427743.483011:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789427743.483038:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8107:x1876350939968768:12345-0@lo:1000: Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427743.483046:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427743.483056:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350939969920:12345-0@lo:41: Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.483059:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939968768:0@lo:1000: 00000100:00100000:0.0:1789427743.483067:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427743.483083:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939969920:0@lo:41: 00000040:01000000:3.0:1789427743.483088:0:8107:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789427743.483112:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970048:0@lo:1000: 00000100:00100000:3.0:1789427743.483136:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.483154:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427743.483160:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970048 00000100:00100000:1.0:1789427743.483165:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970048 00000100:00100000:1.0:1789427743.483192:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427743.483199:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970048:12345-0@lo:1000: 00000100:00100000:1.0:1789427743.483304:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970048:12345-0@lo:1000: Request processed in 105us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427743.483309:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789427743.483315:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970048:0@lo:1000: 00000100:00100000:3.0:1789427743.483346:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970176:0@lo:700: 00000100:00100000:3.0:1789427743.483366:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.483391:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427743.483400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970176 00000100:00100000:2.0:1789427743.483405:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970176 00000100:00100000:2.0:1789427743.483474:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427743.483484:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970176:12345-0@lo:700: 00000100:00100000:2.0:1789427743.483536:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970176:12345-0@lo:700: Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427743.483541:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970176:0@lo:700: 00000100:00100000:2.0:1789427743.483547:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427743.483659:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970304:0@lo:1000: 00000100:00100000:3.0:1789427743.483678:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.483694:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.483709:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970304 00000100:00100000:0.0:1789427743.483713:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970304 00000100:00100000:0.0:1789427743.483732:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427743.483736:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970304:12345-0@lo:1000: 00000100:00100000:0.0:1789427743.483773:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970304:12345-0@lo:1000: Request processed in 36us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.483778:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427743.483792:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970304:0@lo:1000: 00000004:00080000:3.0:1789427743.483820:0:8107:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff91968886df00 with version 0 00000020:00100000:3.0:1789427743.483832:0:8107:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789427743.483837:0:8107:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9196a9809880 x1876350939970560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789427743.483858:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970560:0@lo:1000: 00000100:00100000:3.0:1789427743.483878:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.483893:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427743.483911:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970560 00000100:00100000:1.0:1789427743.483915:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970560 00000100:00100000:1.0:1789427743.483933:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427743.483937:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876350939970560:12345-0@lo:1000: 00000001:00080000:2.0:1789427743.484772:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789427743.484777:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789427743.484837:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8107:x1876350939970560:12345-0@lo:1000: Request processed in 899us (957us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789427743.484843:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789427743.484860:0:8107:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789427743.484865:0:8107:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789427743.484874:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970560:0@lo:1000: 00000100:00100000:3.0:1789427743.484910:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970688:0@lo:1000: 00000100:00100000:3.0:1789427743.484930:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427743.484945:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427743.484957:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970688 00000100:00100000:0.0:1789427743.484961:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970688 00000100:00100000:0.0:1789427743.484980:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427743.484984:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8107:x1876350939970688:12345-0@lo:1000: 00000100:00100000:0.0:1789427743.485020:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8107:x1876350939970688:12345-0@lo:1000: Request processed in 36us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427743.485024:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789427743.485044:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8107:1876350939970688:0@lo:1000: 00000040:00080000:3.0:1789427743.485055:0:8107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789427743.485075:0:8107:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff91968886df00 with version 1 00000004:00080000:2.0:1789427743.485093:0:8105:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff919682f64600 version 1 rpc_version 1 00000020:00100000:2.0:1789427743.485109:0:8105:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789427743.485114:0:8105:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9196bbd71f80 x1876350939970944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427743.485129:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8105:1876350939970944:0@lo:1000: 00000100:00100000:2.0:1789427743.485150:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427743.485164:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427743.485191:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939970944 00000100:00100000:1.0:1789427743.485196:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939970944 00000100:00100000:1.0:1789427743.485223:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789427743.485231:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8105:x1876350939970944:12345-0@lo:1000: 00000001:00080000:2.0:1789427743.485737:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1789427743.485798:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8105:x1876350939970944:12345-0@lo:1000: Request processed in 569us (646us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789427743.485805:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1789427743.485809:0:8105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789427743.485812:0:8105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789427743.485821:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8105:1876350939970944:0@lo:1000: 00000040:00080000:3.0:1789427743.487698:0:8107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789427743.487733:0:8107:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789427743.487736:0:8107:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789427744.176771:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.201539:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789427745.705668:0:8393:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789427745.705672:0:8393:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789427745.705673:0:8393:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789427745.705852:0:8393:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196bc9e1800 00000020:01000004:0.0:1789427745.705865:0:8393:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789427745.705876:0:8393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789427745.705895:0:8393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9196bcb419c0) 00000020:00000080:0.0:1789427745.705911:0:8393:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789427745.721574:0:8393:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789427745.721615:0:8393:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789427745.730821:0:8393:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789427745.731233:0:8393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789427745.731245:0:8393:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789427745.731263:0:8393:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede518068 00000020:01000004:3.0:1789427745.731271:0:8393:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789427745.731291:0:8393:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789427745.731295:0:8393:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789427745.731301:0:8393:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789427745.731306:0:8393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789427745.731318:0:8393:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9196bbde3380) 00000020:00000080:3.0:1789427745.731337:0:8393:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789427745.733069:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427745.733540:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789427745.733549:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789427745.733947:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789427745.733957:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789427745.734378:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789427745.734386:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789427745.735763:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427745.735916:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789427745.735921:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789427745.736229:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789427745.736237:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789427745.748647:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427745.748901:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789427745.748908:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789427745.750210:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789427745.750216:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789427745.750518:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789427745.750523:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789427745.752696:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427745.752820:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789427745.752825:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789427745.753215:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789427745.753222:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789427745.777628:0:8393:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427745.777821:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789427745.777828:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789427745.778682:0:8393:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789427745.778694:0:8393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789427745.778965:0:8393:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789427745.778990:0:8393:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789427745.778996:0:8393:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789427745.791877:0:8393:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789427745.791912:0:8393:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789427745.791915:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789427745.791917:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427745.791919:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427745.791920:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427745.791921:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427745.791922:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427745.791924:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427745.791925:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427745.791926:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427745.791928:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427745.791932:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789427745.791935:0:8393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789427745.791938:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427745.791939:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427745.791940:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427745.791941:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427745.791942:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427745.791943:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427745.791944:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427745.791945:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427745.791946:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427745.791947:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427745.791948:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789427745.791977:0:8393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789427745.791993:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939971072:0@lo:253: 00000100:00100000:0.0:1789427745.792062:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.792118:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.792132:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971072 00000100:00100000:3.0:1789427745.792141:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971072 00000100:00100000:3.0:1789427745.792196:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789427745.792205:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:8393:x1876350939971072:12345-0@lo:253: 20000000:01000000:3.0:1789427745.792244:0:6477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789427745.792248:0:6477:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789427745.792252:0:6477:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789427745.792255:0:6477:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789427745.792460:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427745.792545:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789427745.792554:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789427745.792567:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789427745.792570:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789427745.792577:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789427745.792584:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789427745.792680:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789427745.792693:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:3.0:1789427745.792695:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:3.0:1789427745.792714:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789427745.792722:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789427745.792737:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789427745.792743:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:3.0:1789427745.792756:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789427745.792763:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789427745.792775:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789427745.792791:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789427745.792882:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789427745.792892:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:3.0:1789427745.792893:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:3.0:1789427745.792905:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789427745.792911:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789427745.792925:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789427745.792930:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:3.0:1789427745.792942:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789427745.792947:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789427745.792959:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789427745.792974:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789427745.793308:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789427745.793320:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:3.0:1789427745.793322:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:3.0:1789427745.793335:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789427745.793340:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789427745.793348:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789427745.793350:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:3.0:1789427745.793369:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789427745.793374:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789427745.793383:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789427745.793402:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789427745.793411:0:6477:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789427745.793432:0:6477:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789427745.793436:0:6477:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789427745.793471:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789427745.793473:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789427745.793843:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789427745.794029:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789427745.794047:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789427745.794056:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789427745.794064:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789427745.794065:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427745.794329:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427745.794348:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427745.794381:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789427745.794513:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789427745.794535:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789427745.794564:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789427745.794574:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789427745.794581:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789427745.794899:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789427745.794919:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789427745.794936:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789427745.795035:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789427745.795065:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789427745.795078:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1789427745.795089:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789427745.795091:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427745.795316:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427745.795332:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427745.795345:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789427745.795477:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789427745.795492:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789427745.795504:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1789427745.795518:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789427745.795536:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795552:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517f3b expref: 18 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795561:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 18 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795568:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fff expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795574:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51801b expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795578:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518053 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795583:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795613:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795638:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 18 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.795651:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971200:0@lo:104: 00000100:00100000:3.0:1789427745.795700:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.795746:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971200 00010000:00010000:3.0:1789427745.795747:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.795755:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971200 00010000:00010000:3.0:1789427745.795761:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 18 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.795769:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971328:0@lo:104: 00000100:00100000:0.0:1789427745.795799:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789427745.795806:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.795815:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971200:12345-0@lo:104: 00010000:00010000:0.0:1789427745.795829:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.795830:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971328 00000100:00100000:2.0:1789427745.795836:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971328 00010000:00010000:3.0:1789427745.795842:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.795853:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 18 pid: 6478 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.795859:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789427745.795864:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971456:0@lo:104: 00000100:00100000:2.0:1789427745.795868:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6477:x1876350939971328:12345-0@lo:104: 00010000:00010000:2.0:1789427745.795878:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.795894:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427745.795903:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6477:x1876350939971200:12345-0@lo:104: Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.795911:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.795916:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427745.795934:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971456 00010000:00010000:2.0:1789427745.795937:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427745.795937:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971456 00000100:00100000:2.0:1789427745.795948:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6477:x1876350939971328:12345-0@lo:104: Request processed in 80us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427745.795949:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789427745.795959:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 18 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.795959:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.795960:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789427745.795971:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789427745.795979:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:0.0:1789427745.795985:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971456:12345-0@lo:104: 00010000:00010000:3.0:1789427745.795986:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 18 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.795986:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789427745.795987:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.795994:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796009:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.796009:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796015:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971584:0@lo:104: 00010000:00010000:2.0:1789427745.796015:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427745.796022:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427745.796022:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427745.796041:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427745.796045:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427745.796054:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427745.796060:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427745.796073:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.796075:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427745.796077:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427745.796082:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796085:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971456:12345-0@lo:104: Request processed in 102us (176us total) trans 0 rc 0/0 00010000:00010000:2.0:1789427745.796101:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427745.796105:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789427745.796115:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427745.796122:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971584 00010000:00010000:3.0:1789427745.796124:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 18 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796126:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796127:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971584 00010000:00010000:1.0:1789427745.796128:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796148:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede518053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51805a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796148:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789427745.796149:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede51801b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518022 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796159:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971584:12345-0@lo:104: 00010000:00010000:3.0:1789427745.796163:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 18 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796173:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427745.796175:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796177:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796182:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971968:0@lo:104: 00010000:00010000:1.0:1789427745.796201:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813edc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427745.796205:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796213:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796215:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427745.796219:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427745.796223:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789427745.796224:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427745.796232:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789427745.796240:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939971712:0@lo:103: 00000100:00100000:3.0:1789427745.796250:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427745.796251:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789427745.796253:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796262:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971584:12345-0@lo:104: Request processed in 103us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427745.796264:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427745.796274:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427745.796276:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427745.796281:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427745.796282:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796291:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede517fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518006 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796293:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971968 00000100:00100000:0.0:1789427745.796298:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971968 00000100:00100000:3.0:1789427745.796303:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971200:0@lo:104: 00000100:00100000:2.0:1789427745.796312:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789427745.796316:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427745.796321:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796322:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939971840:0@lo:103: 00000100:00100000:3.0:1789427745.796325:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971328:0@lo:104: 00000100:00100000:0.0:1789427745.796328:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789427745.796338:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427745.796344:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796344:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971968:12345-0@lo:104: 00000100:00100000:3.0:1789427745.796349:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971456:0@lo:104: 00010000:00010000:0.0:1789427745.796373:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796375:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796385:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.796388:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971584:0@lo:104: 10000000:00010000:1.0:1789427745.796393:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427745.796399:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789427745.796441:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427745.796444:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971712 00010000:00010000:1.0:1789427745.796444:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796450:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971712 00000100:00100000:2.0:1789427745.796452:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939972096:0@lo:103: 00010000:00010000:1.0:1789427745.796456:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427745.796466:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.796472:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789427745.796473:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede517fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fb9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796478:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 19 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796485:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.796486:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6477:x1876350939971968:12345-0@lo:104: Request processed in 144us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427745.796497:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427745.796503:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796504:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789427745.796523:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939971840 00010000:00010000:1.0:1789427745.796523:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427745.796526:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796527:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939972224:0@lo:103: 00000100:00100000:3.0:1789427745.796529:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939971840 00010000:00010000:0.0:1789427745.796531:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427745.796539:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796552:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 20 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427745.796553:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.796554:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972096 00000100:00100000:0.0:1789427745.796562:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972096 00000100:00100000:2.0:1789427745.796564:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789427745.796574:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427745.796583:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 21 pid: 6478 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796587:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972224 00000100:00100000:3.0:1789427745.796592:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972224 00010000:00010000:1.0:1789427745.796596:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796607:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427745.796608:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 22 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796615:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427745.796625:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789427745.796627:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796628:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3616:x1876350939971712:12345-0@lo:103: 00000100:00100000:3.0:1789427745.796636:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427745.796640:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3616:x1876350939971840:12345-0@lo:103: 00010000:00010000:2.0:1789427745.796643:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427745.796643:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede517f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517f42 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796651:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 22 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796654:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3614:x1876350939972096:12345-0@lo:103: 00010000:00010000:0.0:1789427745.796657:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427745.796668:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 22 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796670:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427745.796671:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427745.796673:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 22 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796676:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427745.796679:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 22 pid: 6478 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796681:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.796700:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 22 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796715:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699964a00/0x84fc867ede51805a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518053 expref: 22 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796719:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 22 pid: 6478 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.796737:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.796741:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209e00/0x84fc867ede518022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51801b expref: 21 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796746:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965000/0x84fc867ede518006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517fff expref: 21 pid: 6478 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796746:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427745.796762:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427745.796764:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427745.796786:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3616:x1876350939971712:12345-0@lo:103: Request processed in 163us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427745.796794:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427745.796807:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3616:x1876350939971840:12345-0@lo:103: Request processed in 170us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.796814:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3614:x1876350939972096:12345-0@lo:103: Request processed in 161us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427745.796814:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427745.796823:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427745.796824:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3614:x1876350939972224:12345-0@lo:103: 00000100:00100000:3.0:1789427745.796830:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789427745.796832:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427745.796838:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 17 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796845:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 16 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.796854:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208400/0x84fc867ede517fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517fb2 expref: 16 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.796858:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939972352:0@lo:103: 00010000:00010000:2.0:1789427745.796864:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427745.796883:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939972096:0@lo:103: 00000100:00100000:3.0:1789427745.796890:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427745.796901:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3614:x1876350939972224:12345-0@lo:103: Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427745.796911:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427745.796911:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939972224:0@lo:103: 00000100:00100000:1.0:1789427745.796932:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972352 00000100:00100000:3.0:1789427745.796935:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1876350939971968:0@lo:104: 00000100:00100000:1.0:1789427745.796939:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972352 00010000:00010000:1.0:1789427745.796962:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 15 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.796964:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.796965:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939971840:0@lo:103: 00000100:00100000:2.0:1789427745.796982:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939971712:0@lo:103: 00000100:00100000:1.0:1789427745.797013:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427745.797019:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688837850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3615:x1876350939972352:12345-0@lo:103: 00010000:00010000:1.0:1789427745.797025:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427745.797028:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 15 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797037:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 15 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797048:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209600/0x84fc867ede517f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517f3b expref: 15 pid: 6475 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797058:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797066:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797079:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797083:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797088:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797092:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797102:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427745.797105:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797110:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797120:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.797127:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427745.797132:0:6477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.797142:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.797149:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965800/0x84fc867ede518076 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.797163:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688837850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:3615:x1876350939972352:12345-0@lo:103: Request processed in 141us (272us total) trans 0 rc 0/0 20000000:01000000:3.0:1789427745.797170:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789427745.797175:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427745.797191:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939972352:0@lo:103: 00000100:00100000:3.0:1789427745.799310:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8393:x1876350939971072:12345-0@lo:253: Request processed in 7102us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.799320:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789427745.799345:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939971072:0@lo:253: 10000000:01000000:0.0:1789427745.799369:0:8393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789427745.799373:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789427745.799375:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427745.799384:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427745.799386:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789427745.799387:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427745.799388:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427745.799390:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427745.799391:0:8393:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789427745.799393:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427745.799394:0:8393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789427745.799410:0:8393:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bc9e1800 from lustre-OST0000 10000000:01000000:0.0:1789427745.799472:0:8393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789427745.799476:0:8393:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789427745.799490:0:8393:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688454d40 local copy 10000000:01000000:0.0:1789427745.799494:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789427745.799524:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.799534:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.799542:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.799566:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972480:0@lo:101: 00000100:00100000:0.0:1789427745.799595:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.799626:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.799639:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972480 00000100:00100000:3.0:1789427745.799646:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972480 00000100:00100000:3.0:1789427745.799685:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789427745.799693:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+13:8393:x1876350939972480:12345-0@lo:101: 00010000:00010000:3.0:1789427745.799705:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427745.799717:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964400/0x84fc867ede518084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51807d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.799738:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964400/0x84fc867ede518084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51807d expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.799748:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964400/0x84fc867ede518084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51807d expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.799756:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964400, rc 0) 00000100:00100000:3.0:1789427745.799931:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972480:12345-0@lo:101: Request processed in 238us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427745.799932:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972480:0@lo:101: 00000100:00100000:3.0:1789427745.799941:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789427745.799950:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.799960:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.800044:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972608:0@lo:501: 00000100:00100000:1.0:1789427745.800072:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.800097:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.800143:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972608 00000100:00100000:3.0:1789427745.800148:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972608 00000100:00100000:3.0:1789427745.800179:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789427745.800186:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972608:12345-0@lo:501: 00000100:00100000:3.0:1789427745.800277:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972608:12345-0@lo:501: Request processed in 91us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789427745.800291:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427745.800353:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972608:0@lo:501: 10000000:01000000:1.0:1789427745.800540:0:8393:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789427745.800554:0:8393:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789427745.800562:0:8393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800567:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800572:0:8393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800587:0:8393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789427745.800603:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196bc9e1800 10000000:01000000:1.0:1789427745.800608:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789427745.800612:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789427745.800613:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789427745.800618:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789427745.800622:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427745.800624:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789427745.800629:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427745.800637:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427745.800642:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800647:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800656:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.800664:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800665:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427745.800679:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.800681:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972736:0@lo:101: 10000000:01000000:0.0:1789427745.800687:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427745.800706:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.800710:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789427745.800715:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427745.800728:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.800734:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede51807d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede518084 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.800741:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.800743:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.800745:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427745.800750:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939972864:0@lo:103: 00000100:00100000:1.0:1789427745.800786:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427745.800787:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.800830:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972736 00000100:00100000:3.0:1789427745.800834:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972736 00000100:00100000:3.0:1789427745.800852:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789427745.800857:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972736:12345-0@lo:101: 00010000:00010000:3.0:1789427745.800863:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427745.800870:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51808b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.800879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972864 00010000:00010000:3.0:1789427745.800882:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51808b expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.800884:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972864 00010000:00010000:3.0:1789427745.800891:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51808b expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.800896:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965c00, rc 0) 00000100:00100000:0.0:1789427745.800918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427745.800930:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939972736:12345-0@lo:101: Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.800931:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3616:x1876350939972864:12345-0@lo:103: 00000100:00100000:3.0:1789427745.800942:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1789427745.800946:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427745.800971:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972736:0@lo:101: 00010000:00010000:0.0:1789427745.800972:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699964400/0x84fc867ede518084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51807d expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.800982:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.800983:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427745.801010:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.801016:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:3616:x1876350939972864:12345-0@lo:103: Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.801022:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427745.801034:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939972864:0@lo:103: 00000100:00100000:1.0:1789427745.801076:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972992:0@lo:501: 00000100:00100000:1.0:1789427745.801102:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.801122:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427745.801396:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939972992 00000100:00100000:0.0:1789427745.801401:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939972992 00000100:00100000:0.0:1789427745.801459:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789427745.801468:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972992:12345-0@lo:501: 00000100:00100000:0.0:1789427745.801687:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939972992:12345-0@lo:501: Request processed in 220us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.801694:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427745.801841:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939972992:0@lo:501: 00000100:00100000:1.0:1789427745.801871:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973120:0@lo:503: 00000100:00100000:1.0:1789427745.801902:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.801927:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.801943:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973120 00000100:00100000:3.0:1789427745.801949:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973120 00000100:00100000:3.0:1789427745.801983:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789427745.801991:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973120:12345-0@lo:503: 00000100:00100000:3.0:1789427745.802074:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973120:12345-0@lo:503: Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.802081:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789427745.802108:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973120:0@lo:503: 00000040:00080000:1.0:1789427745.802323:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427745.802400:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973248:0@lo:502: 00000100:00100000:1.0:1789427745.802456:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.802481:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973248 00000100:00100000:3.0:1789427745.802487:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973248 00000100:00100000:1.0:1789427745.802489:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.802534:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789427745.802540:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973248:12345-0@lo:502: 00000100:00100000:3.0:1789427745.802612:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973248:12345-0@lo:502: Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.802618:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789427745.802653:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973248:0@lo:502: 00000040:00080000:1.0:1789427745.802820:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789427745.802846:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789427745.802861:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789427745.802875:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789427745.802888:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789427745.802903:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789427745.802923:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973376:0@lo:502: 00000100:00100000:1.0:1789427745.802962:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.802984:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427745.803056:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973376 00000100:00100000:0.0:1789427745.803063:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973376 00000100:00100000:0.0:1789427745.803091:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789427745.803098:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973376:12345-0@lo:502: 00000100:00100000:0.0:1789427745.803162:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973376:12345-0@lo:502: Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.803167:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427745.803234:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973376:0@lo:502: 00000040:00080000:1.0:1789427745.803266:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789427745.803273:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789427745.803616:0:8416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789427745.803624:0:8416:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789427745.803638:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427745.803644:0:8416:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789427745.803649:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789427745.803663:0:8416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff919581ddcd40) 00000020:00000080:2.0:1789427745.803676:0:8416:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789427745.803680:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789427745.803747:0:8416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bc9e1800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789427745.803755:0:8416:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789427745.803761:0:8416:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede5180a0 00010000:00010000:2.0:1789427745.807123:0:8416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789427745.811719:0:8416:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789427745.813145:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789427745.813387:0:8416:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789427745.816255:0:8416:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789427745.816483:0:8416:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789427745.819803:0:8416:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789427745.820798:0:8416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789427745.820808:0:8416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427745.820813:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427745.820815:0:8416:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789427745.820818:0:8416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427745.820823:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427745.820824:0:8416:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427745.820828:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427745.820830:0:8416:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427745.820843:0:8416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427745.820846:0:8416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427745.820848:0:8416:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789427745.820851:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789427745.820934:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789427745.821009:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789427745.821028:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.821041:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427745.821049:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bc9e1800 from 1 10000000:01000000:0.0:1789427745.821052:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427745.821087:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.821096:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.821118:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.821140:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973504:0@lo:101: 00000100:00100000:0.0:1789427745.821194:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.821236:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.822266:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973504 00000100:00100000:3.0:1789427745.822275:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973504 00000100:00100000:3.0:1789427745.822318:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789427745.822329:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:8393:x1876350939973504:12345-0@lo:101: 00010000:00010000:3.0:1789427745.822341:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427745.822354:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5180a7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.822390:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.822402:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.822411:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965800, rc 0) 00000100:00100000:3.0:1789427745.822487:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973504:12345-0@lo:101: Request processed in 160us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.822495:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427745.822520:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973504:0@lo:101: 00010000:00010000:1.0:1789427745.822536:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.822546:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.822635:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973632:0@lo:501: 00000100:00100000:1.0:1789427745.822666:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427745.822691:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973632 00000100:00100000:2.0:1789427745.822696:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973632 00000100:00100000:1.0:1789427745.822699:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427745.822754:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789427745.822762:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973632:12345-0@lo:501: 00000100:00100000:2.0:1789427745.822847:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973632:12345-0@lo:501: Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427745.822854:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789427745.822881:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973632:0@lo:501: 00000100:00100000:1.0:1789427745.822912:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973760:0@lo:503: 00000100:00100000:1.0:1789427745.822953:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.822986:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.823016:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973760 00000100:00100000:3.0:1789427745.823020:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973760 00000100:00100000:3.0:1789427745.823053:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789427745.823069:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973760:12345-0@lo:503: 00000100:00100000:3.0:1789427745.823146:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973760:12345-0@lo:503: Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.823158:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789427745.823220:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973760:0@lo:503: 00000040:00080000:1.0:1789427745.823454:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427745.823516:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973888:0@lo:502: 00000100:00100000:1.0:1789427745.823550:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.823578:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427745.823716:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939973888 00000100:00100000:2.0:1789427745.823720:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939973888 00000100:00100000:2.0:1789427745.823772:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789427745.823779:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973888:12345-0@lo:502: 00000100:00100000:2.0:1789427745.823856:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939973888:12345-0@lo:502: Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427745.823864:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427745.823869:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939973888:0@lo:502: 00000040:00080000:1.0:1789427745.824025:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789427745.824050:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789427745.824071:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974016:0@lo:502: 00000100:00100000:1.0:1789427745.824104:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.824125:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.824137:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974016 00000100:00100000:3.0:1789427745.824142:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974016 00000100:00100000:3.0:1789427745.824173:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789427745.824179:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939974016:12345-0@lo:502: 00000100:00100000:3.0:1789427745.824248:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939974016:12345-0@lo:502: Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.824260:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789427745.824497:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974016:0@lo:502: 00000040:00080000:3.0:1789427745.824552:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789427745.824561:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789427745.824839:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427745.824847:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427745.824850:0:8420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789427745.824857:0:8420:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bc9e1800 00000020:00000080:3.0:1789427745.824859:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789427745.824870:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427745.824872:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427745.824873:0:8420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789427745.824876:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789427745.825167:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789427745.825203:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427745.825233:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.825243:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427745.825294:0:8393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789427745.825297:0:8393:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196bc9e1800 10000000:01000000:1.0:1789427745.825300:0:8393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196bc9e1800 10000000:01000000:1.0:1789427745.825304:0:8393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427745.825308:0:8393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bc9e1800 from 1 10000000:01000000:1.0:1789427745.825311:0:8393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789427745.825332:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.825351:0:8393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.825371:0:8393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.825385:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974144:0@lo:101: 00000100:00100000:1.0:1789427745.825448:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.825479:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.825939:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974144 00000100:00100000:3.0:1789427745.825954:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974144 00000100:00100000:3.0:1789427745.826000:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789427745.826010:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8393:x1876350939974144:12345-0@lo:101: 00010000:00010000:3.0:1789427745.826020:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427745.826033:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5180b5 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.826510:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 16 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.826523:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 16 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.826532:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965000, rc 0) 00000100:00100000:3.0:1789427745.826578:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974144:12345-0@lo:101: Request processed in 570us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.826586:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789427745.826657:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974144:0@lo:101: 00010000:00010000:1.0:1789427745.826671:0:8393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.826681:0:8393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.826756:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974272:0@lo:501: 00000100:00100000:1.0:1789427745.826782:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.826810:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.827081:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974272 00000100:00100000:3.0:1789427745.827086:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974272 00000100:00100000:3.0:1789427745.827114:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789427745.827122:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974272:12345-0@lo:501: 00000100:00100000:3.0:1789427745.827204:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974272:12345-0@lo:501: Request processed in 82us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.827211:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789427745.827344:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974272:0@lo:501: 00000100:00100000:0.0:1789427745.827386:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974400:0@lo:503: 00000100:00100000:0.0:1789427745.827444:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.827466:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085600 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.828182:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974400 00000100:00100000:3.0:1789427745.828187:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974400 00000100:00100000:3.0:1789427745.828220:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789427745.828228:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974400:12345-0@lo:503: 00000100:00100000:3.0:1789427745.828303:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974400:12345-0@lo:503: Request processed in 75us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.828310:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789427745.828331:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974400:0@lo:503: 00000040:00080000:0.0:1789427745.828584:0:8393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789427745.828666:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974528:0@lo:502: 00000100:00100000:0.0:1789427745.828702:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.828732:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085600 going to sleep for 11 seconds 00000100:00100000:1.0:1789427745.828734:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974528 00000100:00100000:1.0:1789427745.828739:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974528 00000100:00100000:1.0:1789427745.828762:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789427745.828767:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974528:12345-0@lo:502: 00000100:00100000:1.0:1789427745.828830:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974528:12345-0@lo:502: Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427745.828834:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427745.828903:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974528:0@lo:502: 00000040:00080000:0.0:1789427745.829082:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789427745.829107:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789427745.829123:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789427745.829136:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789427745.829148:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789427745.829159:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789427745.829170:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789427745.829180:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789427745.829193:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789427745.829206:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789427745.829229:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789427745.829242:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789427745.829254:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789427745.829268:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789427745.829281:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789427745.829295:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789427745.829322:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789427745.829338:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789427745.829351:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789427745.830164:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789427745.830186:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789427745.830202:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789427745.830217:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789427745.830233:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789427745.830247:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789427745.830261:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789427745.830273:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789427745.830287:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789427745.830300:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789427745.830314:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789427745.830326:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789427745.830338:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789427745.830377:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789427745.830394:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789427745.830408:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789427745.830439:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789427745.830455:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789427745.830484:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974656:0@lo:502: 00000100:00100000:0.0:1789427745.830544:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.830578:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974656 00000100:00100000:3.0:1789427745.830584:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974656 00000100:00100000:0.0:1789427745.830584:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085600 going to sleep for 11 seconds 00000100:00100000:3.0:1789427745.830615:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789427745.830626:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974656:12345-0@lo:502: 00000100:00100000:3.0:1789427745.830699:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939974656:12345-0@lo:502: Request processed in 74us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.830703:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789427745.830733:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939974656:0@lo:502: 00000040:00080000:0.0:1789427745.830779:0:8393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789427745.830787:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789427745.831233:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789427745.831244:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9196bbde0000) 00000020:00000080:3.0:1789427745.831260:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789427745.831312:0:8421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bc9e1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789427745.831315:0:8421:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bc9e1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789427745.831316:0:8421:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bc9e1800 3 00010000:00080000:3.0:1789427745.831337:0:8421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bbdd6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789427745.832606:0:8421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789427745.832754:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789427745.832786:0:8421:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789427745.832796:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x84fc867ede5180ca 00000100:00080000:3.0:1789427745.832803:0:8421:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789427745.832812:0:8421:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9196bbdd6000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427745.832840:0:8421:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919581dbfb80 x1876350939974784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789427745.832867:0:8421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789427745.832958:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350939974784:0@lo:38: 00000100:00100000:0.0:1789427745.832990:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939974912:0@lo:400: 00000100:00100000:1.0:1789427745.833028:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789427745.833029:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789427745.833039:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9196bbde4d40) 00000100:00100000:0.0:1789427745.833049:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939975040:0@lo:400: 00000020:00000080:3.0:1789427745.833052:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:0.0:1789427745.833087:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789427745.833121:0:8421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bc9e1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789427745.833125:0:8421:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bc9e1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789427745.833128:0:8421:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bc9e1800 3 00010000:00080000:3.0:1789427745.833151:0:8421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bbdd2000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.124@tcp at head 00000100:00100000:1.0:1789427745.833166:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974784 00000100:00100000:1.0:1789427745.833182:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974784 00000100:00100000:0.0:1789427745.833196:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975040 00000100:00100000:0.0:1789427745.833212:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975040 00000100:00100000:1.0:1789427745.833216:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427745.833224:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350939974784:12345-0@lo:38: 00010000:00080000:1.0:1789427745.833245:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 90 last 0 00000100:00100000:0.0:1789427745.833254:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427745.833263:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939975040:12345-0@lo:400: 00000020:00000080:1.0:1789427745.833278:0:6484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x84fc867ede5180d8 00000004:00100000:1.0:1789427745.833293:0:6484:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789427745.833323:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9196bc9eb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427745.833327:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939975040:12345-0@lo:400: Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.833334:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789427745.833392:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3612:x1876350939974784:12345-0@lo:38: Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.833397:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.833405:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427745.833455:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939974912 00000100:00100000:1.0:1789427745.833459:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939974912 00000100:00100000:0.0:1789427745.833478:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939975040:0@lo:400: 00000100:00100000:1.0:1789427745.833499:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427745.833509:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939974912:12345-0@lo:400: 00000100:00100000:0.0:1789427745.833511:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939975168:0@lo:400: 00000100:00100000:1.0:1789427745.833559:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939974912:12345-0@lo:400: Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.833559:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.833570:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427745.833585:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427745.833587:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975168 00000100:00100000:1.0:1789427745.833592:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975168 00000100:00100000:0.0:1789427745.833594:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939975296:0@lo:400: 00000100:00100000:1.0:1789427745.833620:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427745.833628:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939975168:12345-0@lo:400: 00000100:00100000:0.0:1789427745.833638:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427745.833672:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939975168:12345-0@lo:400: Request processed in 44us (114us total) trans 0 rc 0/0 00010000:00080000:0.0:1789427745.833674:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196ad92ad80 x1876350939975168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427745.833687:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427745.833693:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939975168:0@lo:400: 00000100:00100000:0.0:1789427745.833723:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975296 00000100:00100000:0.0:1789427745.833727:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975296 00010000:00080000:1.0:1789427745.833731:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919581dbfb80 x1876350939974784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427745.833741:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427745.833747:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789427745.833755:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:0.0:1789427745.833757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789427745.833760:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789427745.833764:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789427745.833768:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939975296:12345-0@lo:400: 00000100:00100000:1.0:1789427745.833773:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350939974784:0@lo:38: 00000100:00100000:0.0:1789427745.833829:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939975296:12345-0@lo:400: Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.833836:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789427745.833864:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196ad929180 x1876350939974912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427745.833873:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939974912:0@lo:400: 00000100:00100000:0.0:1789427745.833896:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939975296:0@lo:400: 00010000:00010000:3.0:1789427745.835307:0:8421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789427745.835564:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789427745.835598:0:8421:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789427745.835609:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x84fc867ede5180df 00000100:00080000:3.0:1789427745.835616:0:8421:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789427745.835625:0:8421:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9196bbdd2000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427745.835651:0:8421:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919581dbc380 x1876350939975424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789427745.835680:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350939975424:0@lo:38: 00000100:00100000:3.0:1789427745.835730:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.835774:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975424 00000100:00100000:3.0:1789427745.835780:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975424 00000100:00100000:3.0:1789427745.835807:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427745.835814:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350939975424:12345-0@lo:38: 00010000:00080000:3.0:1789427745.835834:0:8108:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 90 last 0 00000020:00000080:3.0:1789427745.835871:0:8108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x84fc867ede5180e6 00000004:00100000:3.0:1789427745.835882:0:8108:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789427745.835905:0:8108:0:(import.c:65:import_set_state_nolock()) ffff9195826c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427745.835949:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3612:x1876350939975424:12345-0@lo:38: Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427745.835955:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789427745.835984:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919581dbc380 x1876350939975424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427745.835993:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789427745.835998:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789427745.836004:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789427745.836007:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789427745.836009:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789427745.836020:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350939975424:0@lo:38: 00000100:00080000:3.0:1789427745.836036:0:8421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789427745.836283:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1789427745.836327:0:8393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789427745.836490:0:8393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427745.836502:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.836512:0:8393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427745.836554:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789427745.836555:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427745.836557:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427745.836558:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427745.836558:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427745.836559:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427745.836560:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427745.836561:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427745.836562:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427745.836563:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427745.836564:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427745.836567:0:8393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789427745.836569:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427745.836570:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427745.836571:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427745.836571:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427745.836576:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427745.836577:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427745.836577:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427745.836578:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427745.836579:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427745.836579:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427745.836580:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427745.836595:0:8393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789427745.836604:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939975552:0@lo:253: 00000100:00100000:0.0:1789427745.836642:0:8393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.836673:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085840 going to sleep for 11 seconds 00000100:00100000:1.0:1789427745.836718:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975552 00000100:00100000:1.0:1789427745.836724:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975552 00000100:00100000:1.0:1789427745.836791:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789427745.836800:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939975552:12345-0@lo:253: 20000000:01000000:1.0:1789427745.836821:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789427745.836835:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789427745.839302:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789427745.839319:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789427745.839338:0:6498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789427745.839345:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789427745.839380:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839398:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839407:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51800d expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839446:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839481:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839502:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 16 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.839515:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939975680:0@lo:104: 00000100:00100000:2.0:1789427745.839560:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:8393:x1876350939975552:12345-0@lo:253: Request processed in 2760us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427745.839569:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427745.839575:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:1.0:1789427745.839635:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427745.839644:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 15 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427745.839654:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939975808:0@lo:104: 00000100:00100000:1.0:1789427745.839675:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427745.839734:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8393:1876350939975552:0@lo:253: 10000000:01000000:1.0:1789427745.839747:0:8393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789427745.839750:0:8393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427745.839752:0:8393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789427745.839753:0:8393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427745.839755:0:8393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427745.839757:0:8393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427745.839758:0:8393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427745.839760:0:8393:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427745.839761:0:8393:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427745.839762:0:8393:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427745.839764:0:8393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427745.839766:0:8393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789427745.839794:0:8393:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789427745.840794:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789427745.840821:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.840849:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975680 00000100:00100000:0.0:1789427745.840855:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975680 00000100:00100000:0.0:1789427745.840890:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975808 00000100:00100000:0.0:1789427745.840893:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975808 00000100:00100000:0.0:1789427745.840913:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427745.840922:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bc957450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939975680:12345-0@lo:104: 00010000:00010000:0.0:1789427745.840935:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.840987:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427745.840994:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bc957450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939975680:12345-0@lo:104: Request processed in 74us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.841001:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427745.841039:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427745.841046:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939975808:12345-0@lo:104: 00010000:00010000:0.0:1789427745.841054:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841089:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427745.841101:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939975808:12345-0@lo:104: Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.841108:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789427745.841133:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427745.841140:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841148:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eda00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427745.841152:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841160:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427745.841167:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427745.841174:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427745.841203:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841208:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427745.841225:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841232:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede51800d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518014 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841246:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427745.841249:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841263:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427745.841266:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841272:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427745.841277:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427745.841281:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427745.841294:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841299:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427745.841305:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841310:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede517fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517fea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841321:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.841322:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.841323:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427745.841328:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427745.841338:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939975936:0@lo:103: 00000100:00100000:0.0:1789427745.841611:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427745.841649:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427745.841655:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939976064:0@lo:103: 00000100:00100000:0.0:1789427745.841685:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427745.841733:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939975936 00000100:00100000:3.0:1789427745.841739:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939975936 00000100:00100000:0.0:1789427745.841749:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939975680:0@lo:104: 00010000:00010000:3.0:1789427745.841762:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 16 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.841762:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939975808:0@lo:104: 00010000:00010000:0.0:1789427745.841785:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.841789:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976064 00000100:00100000:3.0:1789427745.841792:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976064 00010000:00010000:3.0:1789427745.841803:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 17 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.841820:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789427745.841827:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3613:x1876350939975936:12345-0@lo:103: 00000100:00100000:0.0:1789427745.841835:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789427745.841839:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789427745.841846:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3613:x1876350939976064:12345-0@lo:103: 00010000:00010000:3.0:1789427745.841848:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 17 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841859:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427745.841864:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 17 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841867:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 17 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.841888:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208e00/0x84fc867ede518014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51800d expref: 17 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841897:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 16 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427745.841909:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427745.841914:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9e00/0x84fc867ede517fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517fe3 expref: 16 pid: 6477 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841929:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.841937:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789427745.841948:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002603976s 00000100:00100000:3.0:1789427745.841953:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3613:x1876350939975936:12345-0@lo:103: Request processed in 124us (338us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427745.841954:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427745.841969:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789427745.841970:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427745.841975:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939975936:0@lo:103: 00010000:00010000:0.0:1789427745.843142:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.843156:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.843162:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427745.843166:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.843173:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.843198:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427745.843210:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427745.843221:0:6498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.843239:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427745.843246:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ede00/0x84fc867ede5180ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427745.843262:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:3613:x1876350939976064:12345-0@lo:103: Request processed in 1417us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427745.843270:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427745.843319:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939976064:0@lo:103: 00080000:10000000:1.0:1789427745.845750:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789427745.845860:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789427745.845985:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789427745.846086:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789427745.846227:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789427745.846713:0:8393:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789427745.847524:0:8393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789427745.851980:0:8393:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789427745.851988:0:8393:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789427745.852028:0:8393:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789427745.852062:0:8393:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789427745.852081:0:8393:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789427745.852098:0:8393:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789427745.852927:0:8393:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427745.853101:0:8393:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789427746.096629:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939976192:0@lo:41: 00000100:00100000:1.0:1789427746.096696:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427746.096735:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976192 00000100:00100000:0.0:1789427746.096743:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976192 00000100:00100000:0.0:1789427746.096797:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427746.096809:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939976192:12345-0@lo:41: 00000004:00000024:0.0:1789427746.096841:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789427746.096898:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939976192:12345-0@lo:41: Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427746.096906:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789427746.096925:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939976192:0@lo:41: 00000020:00000004:3.0:1789427746.203995:0:8477:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789427746.204203:0:8477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789427746.225517:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427747.248710:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427748.076175:0:8766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789427748.272583:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789427748.448173:0:8818:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427748.448372:0:8818:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789427748.656618:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939976320:0@lo:41: 00000100:00100000:2.0:1789427748.656701:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427748.656756:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976320 00000100:00100000:3.0:1789427748.656765:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976320 00000100:00100000:3.0:1789427748.656819:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427748.656830:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939976320:12345-0@lo:41: 00000004:00000024:3.0:1789427748.656879:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789427748.656944:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939976320:12345-0@lo:41: Request processed in 116us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427748.656953:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427748.656980:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939976320:0@lo:41: 00010000:00010000:0.0:1789427749.296589:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789427750.192507:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427750.192514:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196adadd000 from 30 10000000:01000000:0.0:1789427750.192519:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427750.192561:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.192584:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.192606:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.192630:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976448:0@lo:101: 00000100:00100000:0.0:1789427750.192694:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.192739:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.192998:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976448 00000100:00100000:3.0:1789427750.193007:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976448 00000100:00100000:3.0:1789427750.193061:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789427750.193073:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:6481:x1876350939976448:12345-0@lo:101: 00010000:00010000:3.0:1789427750.193086:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427750.193098:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5180f4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.193120:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.193129:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.193135:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964400, rc 0) 00000100:00100000:3.0:1789427750.193182:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939976448:12345-0@lo:101: Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.193187:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789427750.193228:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976448:0@lo:101: 00010000:00010000:0.0:1789427750.193243:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.193262:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.193327:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976576:0@lo:501: 00000100:00100000:0.0:1789427750.193358:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.193381:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.193402:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976576 00000100:00100000:2.0:1789427750.193407:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976576 00000100:00100000:2.0:1789427750.193455:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789427750.193464:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939976576:12345-0@lo:501: 00000100:00100000:2.0:1789427750.193569:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939976576:12345-0@lo:501: Request processed in 106us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.193576:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789427750.193601:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976576:0@lo:501: 00000100:00100000:0.0:1789427750.193634:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976704:0@lo:503: 00000100:00100000:0.0:1789427750.193678:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.193710:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.193720:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976704 00000100:00100000:3.0:1789427750.193730:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976704 00000100:00100000:3.0:1789427750.193750:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789427750.193755:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939976704:12345-0@lo:503: 00000100:00100000:3.0:1789427750.193816:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939976704:12345-0@lo:503: Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.193822:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789427750.193837:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939976704:0@lo:503: 00000100:00100000:0.0:1789427750.194037:0:8890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8890:1876350939976832:0@lo:502: 00000100:00100000:0.0:1789427750.194067:0:8890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.194082:0:8890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.194105:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976832 00000100:00100000:2.0:1789427750.194110:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976832 00000100:00100000:2.0:1789427750.194138:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789427750.194146:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8890:x1876350939976832:12345-0@lo:502: 00000100:00100000:2.0:1789427750.194227:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8890:x1876350939976832:12345-0@lo:502: Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.194239:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789427750.194242:0:8890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8890:1876350939976832:0@lo:502: 00000100:00100000:0.0:1789427750.194286:0:8890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8890:1876350939976960:0@lo:502: 00000100:00100000:0.0:1789427750.194315:0:8890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.194349:0:8890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.194392:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939976960 00000100:00100000:3.0:1789427750.194396:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939976960 00000100:00100000:3.0:1789427750.194472:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789427750.194478:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8890:x1876350939976960:12345-0@lo:502: 00000100:00100000:3.0:1789427750.194542:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:8890:x1876350939976960:12345-0@lo:502: Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.194548:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789427750.194581:0:8890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8890:1876350939976960:0@lo:502: 00000040:00080000:1.0:1789427750.194606:0:8890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789427750.194673:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789427750.194693:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427750.194701:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.194711:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.194719:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789427750.194721:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196adadd000 from 5 10000000:01000000:0.0:1789427750.194724:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789427750.194741:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.194748:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.194766:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.194779:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977088:0@lo:101: 00000100:00100000:0.0:1789427750.194800:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.194822:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.194844:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977088 00000100:00100000:2.0:1789427750.194850:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977088 00000100:00100000:2.0:1789427750.194877:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427750.194886:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939977088:12345-0@lo:101: 00010000:00010000:2.0:1789427750.194894:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427750.194905:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518102 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.194922:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518102 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.194931:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518102 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.194939:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8e00, rc 0) 00000100:00100000:2.0:1789427750.194980:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939977088:12345-0@lo:101: Request processed in 96us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.194987:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789427750.195062:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977088:0@lo:101: 00010000:00010000:0.0:1789427750.195072:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.195080:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.195118:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977216:0@lo:256: 00000100:00100000:0.0:1789427750.195144:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.195165:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.195191:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977216 00000100:00100000:3.0:1789427750.195196:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977216 00000100:00100000:3.0:1789427750.195222:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789427750.195229:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939977216:12345-0@lo:256: 20000000:01000000:3.0:1789427750.195503:0:6475:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789427750.195519:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789427750.195523:0:6475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789427750.195776:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939977216:12345-0@lo:256: Request processed in 546us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.195784:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789427750.195798:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977216:0@lo:256: 10000000:01000000:0.0:1789427750.195837:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427750.195843:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.195851:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.195857:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789427750.195859:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789427750.195867:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789427750.195880:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.195888:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.195895:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.195906:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977344:0@lo:101: 00000100:00100000:0.0:1789427750.195943:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.195967:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.195986:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977344 00000100:00100000:2.0:1789427750.195991:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977344 00000100:00100000:2.0:1789427750.196018:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427750.196024:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939977344:12345-0@lo:101: 00010000:00010000:2.0:1789427750.196037:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427750.196046:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518110 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.196061:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518110 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.196070:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518110 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.196077:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9e00, rc 0) 00000100:00100000:2.0:1789427750.196110:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939977344:12345-0@lo:101: Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.196117:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789427750.196128:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977344:0@lo:101: 00010000:00010000:0.0:1789427750.196142:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.196150:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.196185:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977472:0@lo:501: 00000100:00100000:0.0:1789427750.196207:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.196227:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.196269:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977472 00000100:00100000:3.0:1789427750.196273:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977472 00000100:00100000:3.0:1789427750.196332:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789427750.196339:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939977472:12345-0@lo:501: 00000100:00100000:3.0:1789427750.196435:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939977472:12345-0@lo:501: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.196448:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977472:0@lo:501: 00000100:00100000:3.0:1789427750.196449:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789427750.196478:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977600:0@lo:503: 00000100:00100000:1.0:1789427750.196509:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.196540:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977600 00000100:00100000:2.0:1789427750.196545:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977600 00000100:00100000:1.0:1789427750.196554:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.196572:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789427750.196580:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939977600:12345-0@lo:503: 00000100:00100000:2.0:1789427750.196670:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939977600:12345-0@lo:503: Request processed in 90us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.196678:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789427750.196700:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939977600:0@lo:503: 00000100:00100000:1.0:1789427750.196944:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8891:1876350939977728:0@lo:502: 00000100:00100000:1.0:1789427750.196986:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.197012:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.197038:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977728 00000100:00100000:2.0:1789427750.197045:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977728 00000100:00100000:2.0:1789427750.197085:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789427750.197095:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8891:x1876350939977728:12345-0@lo:502: 00000100:00100000:2.0:1789427750.197179:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8891:x1876350939977728:12345-0@lo:502: Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.197188:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789427750.197203:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8891:1876350939977728:0@lo:502: 00000020:01000000:1.0:1789427750.197244:0:8891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789427750.197250:0:8891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789427750.197256:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427750.197259:0:8891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789427750.197265:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789427750.197270:0:8891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:1.0:1789427750.197294:0:8891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789427750.197297:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427750.197309:0:8891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff919688890000) 00000020:00000080:1.0:1789427750.197335:0:8891:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789427750.197340:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789427750.197448:0:8891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789427750.197454:0:8891:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789427750.197463:0:8891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede518125 00010000:00080000:1.0:1789427750.197504:0:8891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bcc8d800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789427750.197772:0:8891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789427750.201196:0:8891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789427750.201214:0:8891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789427750.201444:0:8891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427750.201812:0:8891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427750.202070:0:8891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789427750.202206:0:8891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789427750.202762:0:8892:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427750.202767:0:8892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789427750.203595:0:8891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789427750.203605:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789427750.203642:0:8891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789427750.203666:0:8891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede51812c 00000100:00080000:3.0:1789427750.203676:0:8891:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789427750.203687:0:8891:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196bcc8d800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427750.203720:0:8891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919581dbc380 x1876350939977856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427750.203779:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939977856:0@lo:8: 00000100:00100000:0.0:1789427750.203844:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.203895:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977856 00000100:00100000:1.0:1789427750.203902:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977856 00000100:00080000:3.0:1789427750.203912:0:8891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789427750.203972:0:8891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427750.203977:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427750.203979:0:8891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789427750.203982:0:8891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427750.203986:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427750.203987:0:8891:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789427750.203991:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789427750.203993:0:8891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789427750.204016:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8891:1876350939977984:0@lo:502: 00000100:00100000:3.0:1789427750.204056:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.204075:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427750.204079:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.204085:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350939977856:12345-0@lo:8: 00010000:00080000:1.0:1789427750.204109:0:8400:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 94 last 0 00000020:00000080:1.0:1789427750.204139:0:8400:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede518133 00000100:00100000:3.0:1789427750.204177:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939977984 00000100:00100000:3.0:1789427750.204182:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939977984 00002000:00100000:1.0:1789427750.204184:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9196bcc8f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789427750.204188:0:8400:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789427750.204192:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789427750.204217:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00002000:00100000:1.0:1789427750.204226:0:8400:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789427750.204228:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8891:x1876350939977984:12345-0@lo:502: 00000100:00100000:3.0:1789427750.204344:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:8891:x1876350939977984:12345-0@lo:502: Request processed in 118us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.204353:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789427750.204405:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939978112:0@lo:400: 00002000:00080000:1.0:1789427750.204439:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789427750.204459:0:8400:0:(import.c:65:import_set_state_nolock()) ffff9196bcc8d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427750.204464:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.204492:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350939978624:0@lo:400: 00000100:00100000:3.0:1789427750.204525:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.204544:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789427750.204554:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939978240:0@lo:400: 00000100:00100000:3.0:1789427750.204580:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.204600:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350939978752:0@lo:400: 00000100:00100000:3.0:1789427750.204614:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.204629:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939978368:0@lo:400: 00000100:00100000:3.0:1789427750.204643:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.204653:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427750.204656:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939978496:0@lo:400: 00000100:00100000:3.0:1789427750.204670:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.204690:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978240 00000100:00100000:2.0:1789427750.204695:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978240 00000100:00100000:3.0:1789427750.204703:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978112 00000100:00100000:3.0:1789427750.204710:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978112 00000100:00100000:2.0:1789427750.204719:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978496 00000100:00100000:2.0:1789427750.204723:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978496 00000100:00100000:3.0:1789427750.204736:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978624 00000100:00100000:3.0:1789427750.204741:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978624 00000100:00100000:2.0:1789427750.204746:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427750.204756:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939978240:12345-0@lo:400: 00000100:00100000:3.0:1789427750.204769:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978752 00000100:00100000:3.0:1789427750.204773:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978752 00000100:00100000:3.0:1789427750.204785:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978368 00000100:00100000:3.0:1789427750.204787:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978368 00000100:00100000:3.0:1789427750.204806:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789427750.204811:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939978240:12345-0@lo:400: Request processed in 57us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.204813:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939978112:12345-0@lo:400: 00000100:00100000:2.0:1789427750.204821:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427750.204836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789427750.204842:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939978496:12345-0@lo:400: 00000100:00100000:3.0:1789427750.204847:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939978112:12345-0@lo:400: Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.204853:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427750.204866:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427750.204873:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939978496:12345-0@lo:400: Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.204878:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350939978624:12345-0@lo:400: 00000100:00100000:2.0:1789427750.204881:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427750.204912:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350939978624:12345-0@lo:400: Request processed in 35us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.204914:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939978496:0@lo:400: 00000100:00100000:3.0:1789427750.204923:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789427750.204940:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427750.204944:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939978240:0@lo:400: 00000100:00100000:3.0:1789427750.204948:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350939978752:12345-0@lo:400: 00010000:00080000:2.0:1789427750.204961:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbdf80 x1876350939978112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427750.204969:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350939978752:12345-0@lo:400: Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.204970:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939978112:0@lo:400: 00000100:00100000:3.0:1789427750.204980:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789427750.204987:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbd880 x1876350939978624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.204994:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350939978624:0@lo:400: 00000100:00100000:3.0:1789427750.204999:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789427750.205006:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939978368:12345-0@lo:400: 00010000:00080000:2.0:1789427750.205014:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbdc00 x1876350939978752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.205020:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350939978752:0@lo:400: 00000100:00100000:3.0:1789427750.205029:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939978368:12345-0@lo:400: Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.205034:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789427750.205049:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbf800 x1876350939978368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.205054:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939978368:0@lo:400: 00000100:00100000:3.0:1789427750.205069:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8891:1876350939977984:0@lo:502: 00000020:01000000:3.0:1789427750.205084:0:8891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427750.205088:0:8891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427750.205089:0:8891:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789427750.205091:0:8891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789427750.205135:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789427750.205153:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789427750.205160:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.205169:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427750.205176:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789427750.205178:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919684ed8800 from 30 10000000:01000000:2.0:1789427750.205180:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427750.205197:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.205202:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.205209:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427750.205214:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350939977856:12345-0@lo:8: Request processed in 1128us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.205221:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939978880:0@lo:101: 00000100:00100000:1.0:1789427750.205222:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427750.205249:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427750.205260:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbc380 x1876350939977856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.205266:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789427750.205273:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939978880 00000100:00100000:1.0:1789427750.205277:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939978880 00000100:00080000:0.0:1789427750.205277:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00100000:2.0:1789427750.205278:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa600 going to sleep for 11 seconds 00000100:00080000:0.0:1789427750.205285:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789427750.205291:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789427750.205293:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bcc8d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427750.205304:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000004:00080000:0.0:1789427750.205305:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789427750.205312:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939978880:12345-0@lo:101: 00000100:00100000:0.0:1789427750.205312:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939977856:0@lo:8: 00010000:00010000:1.0:1789427750.205333:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427750.205344:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51813a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789427750.205360:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789427750.205361:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51813a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789427750.205365:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427750.205389:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939979008:0@lo:700: 00000100:00100000:0.0:1789427750.205413:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.205451:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789427750.205465:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51813a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.205474:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000004:00080000:3.0:1789427750.205482:0:8892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789427750.205503:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939978880:12345-0@lo:101: Request processed in 193us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.205508:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000004:00080000:3.0:1789427750.205528:0:8892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 94700111643ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789427750.205535:0:8892:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789427750.205535:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939978880:0@lo:101: 00010000:00010000:0.0:1789427750.205546:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.205556:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427750.205571:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979008 00000100:00100000:3.0:1789427750.205575:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979008 00000100:00100000:0.0:1789427750.205598:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979136:0@lo:501: 00000100:00100000:3.0:1789427750.205607:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427750.205614:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8894:x1876350939979008:12345-0@lo:700: 00000100:00100000:0.0:1789427750.205623:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.205639:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8408:1876350939979264:0@lo:700: 00000100:00100000:0.0:1789427750.205655:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1789427750.205667:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427750.205668:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.205677:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979136 00000100:00100000:0.0:1789427750.205680:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979136 00000100:00100000:3.0:1789427750.205684:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.205695:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979264 00000100:00100000:3.0:1789427750.205698:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979264 00000100:00100000:0.0:1789427750.205701:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789427750.205707:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939979136:12345-0@lo:501: 00000100:00100000:3.0:1789427750.205716:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427750.205721:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8408:x1876350939979264:12345-0@lo:700: 00000100:00100000:0.0:1789427750.205797:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939979136:12345-0@lo:501: Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.205811:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789427750.205842:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979136:0@lo:501: 00000100:00100000:0.0:1789427750.205873:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979392:0@lo:503: 00000100:00100000:0.0:1789427750.205913:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.205937:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.205949:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979392 00000100:00100000:0.0:1789427750.205953:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979392 00000100:00100000:0.0:1789427750.205981:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427750.205989:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939979392:12345-0@lo:503: 00000100:00100000:0.0:1789427750.206059:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939979392:12345-0@lo:503: Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.206067:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427750.206103:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979392:0@lo:503: 00000100:00100000:0.0:1789427750.206299:0:8895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8895:1876350939979520:0@lo:502: 00000100:00100000:0.0:1789427750.206348:0:8895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.206406:0:8895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.206520:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979520 00000100:00100000:3.0:1789427750.206524:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979520 00000100:00100000:3.0:1789427750.206551:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789427750.206560:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:8895:x1876350939979520:12345-0@lo:502: 00000100:00100000:3.0:1789427750.206629:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:8895:x1876350939979520:12345-0@lo:502: Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.206636:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789427750.206724:0:8895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8895:1876350939979520:0@lo:502: 00000100:00100000:0.0:1789427750.206758:0:8895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8895:1876350939979648:0@lo:502: 00000100:00100000:0.0:1789427750.206791:0:8895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.206819:0:8895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.206863:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979648 00000100:00100000:3.0:1789427750.206867:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979648 00000100:00100000:3.0:1789427750.207942:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789427750.207949:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:8895:x1876350939979648:12345-0@lo:502: 00000100:00100000:3.0:1789427750.208029:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:8895:x1876350939979648:12345-0@lo:502: Request processed in 79us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.208038:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789427750.208124:0:8895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8895:1876350939979648:0@lo:502: 00000040:00080000:0.0:1789427750.208147:0:8895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000004:00080000:2.0:1789427750.209258:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:2.0:1789427750.209867:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:1.0:1789427750.210427:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789427750.210452:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427750.210459:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.210467:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427750.210473:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427750.210474:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919684ed8800 from 5 10000000:01000000:1.0:1789427750.210476:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427750.210497:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.210503:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.210510:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427750.210522:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979776:0@lo:101: 00000100:00100000:1.0:1789427750.210566:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.210591:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.210600:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979776 00000100:00100000:0.0:1789427750.210606:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979776 00000100:00100000:0.0:1789427750.210648:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789427750.210657:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939979776:12345-0@lo:101: 00010000:00010000:0.0:1789427750.210666:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427750.210677:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518148 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.210698:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518148 expref: 19 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.210721:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518148 expref: 19 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.210729:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209a00, rc 0) 00000100:00100000:0.0:1789427750.210765:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939979776:12345-0@lo:101: Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.210773:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789427750.210797:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979776:0@lo:101: 00010000:00010000:1.0:1789427750.210813:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.210821:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427750.210864:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979904:0@lo:256: 00000100:00100000:1.0:1789427750.210901:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.210930:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.210944:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939979904 00000100:00100000:1.0:1789427750.210948:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939979904 00000100:00100000:1.0:1789427750.210978:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789427750.210987:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939979904:12345-0@lo:256: 20000000:01000000:1.0:1789427750.211000:0:6478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789427750.211015:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789427750.211029:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789427750.211124:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939979904:12345-0@lo:256: Request processed in 138us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.211131:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789427750.211142:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939979904:0@lo:256: 10000000:01000000:0.0:1789427750.211188:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427750.211194:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.211202:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.211210:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789427750.211212:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789427750.211214:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427750.211227:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.211243:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.211251:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.211262:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980032:0@lo:101: 00000100:00100000:0.0:1789427750.211286:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.211306:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.211331:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980032 00000100:00100000:1.0:1789427750.211337:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980032 00000100:00100000:1.0:1789427750.211364:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789427750.211373:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939980032:12345-0@lo:101: 00010000:00010000:1.0:1789427750.211380:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427750.211389:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518156 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.211404:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518156 expref: 20 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.211411:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518156 expref: 20 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.211446:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed800, rc 0) 00000100:00100000:1.0:1789427750.211485:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980032:12345-0@lo:101: Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.211501:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789427750.211538:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980032:0@lo:101: 00010000:00010000:1.0:1789427750.211548:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427750.211556:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427750.211602:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980160:0@lo:501: 00000100:00100000:1.0:1789427750.211689:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.211715:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.211764:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980160 00000100:00100000:0.0:1789427750.211769:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980160 00000100:00100000:0.0:1789427750.211796:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789427750.211805:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980160:12345-0@lo:501: 00000100:00100000:0.0:1789427750.211900:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980160:12345-0@lo:501: Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.211908:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789427750.211913:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980160:0@lo:501: 00000100:00100000:1.0:1789427750.211949:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980288:0@lo:503: 00000100:00100000:1.0:1789427750.211990:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.212010:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.212211:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980288 00000100:00100000:0.0:1789427750.212216:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980288 00000100:00100000:0.0:1789427750.212247:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789427750.212254:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980288:12345-0@lo:503: 00000100:00100000:0.0:1789427750.212343:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980288:12345-0@lo:503: Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.212350:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789427750.212399:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980288:0@lo:503: 00000100:00100000:3.0:1789427750.213397:0:8897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8897:1876350939980416:0@lo:502: 00000100:00100000:2.0:1789427750.213957:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8408:x1876350939979264:12345-0@lo:700: Request processed in 8233us (8285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.213973:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789427750.214012:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbc000 x1876350939979264/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.214026:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8408:1876350939979264:0@lo:700: 40000000:02000000:2.0:1789427750.214038:0:8408:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1789427750.214507:0:8897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.214535:0:8897:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.214590:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980416 00000100:00100000:0.0:1789427750.214595:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980416 00000100:00100000:0.0:1789427750.214663:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789427750.214672:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:8897:x1876350939980416:12345-0@lo:502: 00000100:00100000:0.0:1789427750.214773:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:8897:x1876350939980416:12345-0@lo:502: Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.214779:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789427750.214864:0:8897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8897:1876350939980416:0@lo:502: 00000020:01000000:3.0:1789427750.214887:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789427750.214893:0:8897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789427750.214907:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427750.214909:0:8897:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789427750.214916:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789427750.214919:0:8897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:3.0:1789427750.214938:0:8897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789427750.214941:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427750.214960:0:8897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9196bf988000) 00000020:00000080:3.0:1789427750.214981:0:8897:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789427750.214988:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789427750.215067:0:8897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789427750.215073:0:8897:0:(osd_handler.c:8926:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789427750.215079:0:8897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede51816b 00010000:00080000:3.0:1789427750.215106:0:8897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bc9e8800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789427750.215359:0:8897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1789427750.219105:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789427750.219305:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939979008:12345-0@lo:700: Request processed in 13686us (13885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.219334:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789427750.219363:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad929f80 x1876350939979008/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.219375:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939979008:0@lo:700: 00000040:01000000:3.0:1789427750.219686:0:8897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789427750.219701:0:8897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789427750.219846:0:8897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427750.220010:0:8897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427750.220098:0:8897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789427750.220178:0:8897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789427750.220756:0:8900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427750.220761:0:8900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789427750.221385:0:8897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427750.221397:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789427750.221486:0:8897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789427750.221507:0:8897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede518172 00000100:00080000:0.0:1789427750.221517:0:8897:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427750.221528:0:8897:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9196bc9e8800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789427750.221560:0:8897:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196ad929500 x1876350939980544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427750.221588:0:8897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789427750.221636:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939980544:0@lo:8: 00000020:01000000:0.0:1789427750.221668:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427750.221673:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427750.221676:0:8897:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789427750.221680:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427750.221685:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427750.221687:0:8897:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789427750.221691:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789427750.221693:0:8897:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789427750.221703:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.221719:0:8897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8897:1876350939980672:0@lo:502: 00000100:00100000:3.0:1789427750.221751:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980544 00000100:00100000:3.0:1789427750.221759:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980544 00000100:00100000:0.0:1789427750.221771:0:8897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.221786:0:8897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.221799:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427750.221807:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350939980544:12345-0@lo:8: 00010000:00080000:3.0:1789427750.221828:0:8402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 94 last 0 00000020:00000080:3.0:1789427750.221853:0:8402:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede518179 00002000:00100000:3.0:1789427750.221866:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9196b708c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789427750.221871:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789427750.221880:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789427750.221885:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980672 00000100:00100000:2.0:1789427750.221891:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980672 00002000:00080000:3.0:1789427750.221940:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789427750.221941:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789427750.221952:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:8897:x1876350939980672:12345-0@lo:502: 00000100:00080000:3.0:1789427750.221965:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9196b7089800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427750.222016:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350939980544:12345-0@lo:8: Request processed in 209us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.222023:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427750.222067:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:8897:x1876350939980672:12345-0@lo:502: Request processed in 116us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.222075:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789427750.222078:0:8897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:8897:1876350939980672:0@lo:502: 00000020:01000000:0.0:1789427750.222108:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427750.222113:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427750.222115:0:8897:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789427750.222126:0:8897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:2.0:1789427750.222128:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad929500 x1876350939980544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.222138:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789427750.222145:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789427750.222151:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789427750.222156:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789427750.222159:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:0.0:1789427750.222178:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000004:00080000:2.0:1789427750.222179:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789427750.222192:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939980544:0@lo:8: 10000000:01000000:0.0:1789427750.222205:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:3.0:1789427750.222210:0:8900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1789427750.222215:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.222227:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.222238:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789427750.222240:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688454d40 from 1 10000000:01000000:0.0:1789427750.222244:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:3.0:1789427750.222250:0:8900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 94716833643ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789427750.222257:0:8900:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1789427750.222266:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.222273:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.222279:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.222287:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980800:0@lo:101: 00000100:00100000:0.0:1789427750.222312:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.222337:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.222343:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980800 00000100:00100000:3.0:1789427750.222349:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980800 00000100:00100000:3.0:1789427750.222384:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789427750.222393:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939980800:12345-0@lo:101: 00010000:00010000:3.0:1789427750.222402:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427750.222436:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518180 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.222458:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518180 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.222469:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518180 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.222479:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964a00, rc 0) 00000100:00100000:3.0:1789427750.222519:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939980800:12345-0@lo:101: Request processed in 128us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.222527:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789427750.222538:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980800:0@lo:101: 00010000:00010000:0.0:1789427750.222554:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.222562:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.222604:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980928:0@lo:501: 00000100:00100000:0.0:1789427750.222626:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.222655:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.222853:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939980928 00000100:00100000:2.0:1789427750.222858:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939980928 00000100:00100000:2.0:1789427750.222889:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789427750.222898:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939980928:12345-0@lo:501: 00000100:00100000:2.0:1789427750.222964:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939980928:12345-0@lo:501: Request processed in 67us (338us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427750.222972:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789427750.222978:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939980928:0@lo:501: 10000000:01000000:3.0:1789427750.223006:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789427750.223019:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.223027:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427750.223043:0:8894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789427750.223059:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981184:0@lo:7: 00000100:00100000:2.0:1789427750.223085:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.223115:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981184 00000100:00100000:2.0:1789427750.223118:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.223122:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981184 00000100:00100000:2.0:1789427750.223132:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427750.223142:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939981056:0@lo:13: 00000100:00100000:3.0:1789427750.223157:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427750.223167:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939981184:12345-0@lo:7: 00000100:00100000:2.0:1789427750.223169:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.223201:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981056 00000100:00100000:0.0:1789427750.223226:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981056 00000100:00100000:0.0:1789427750.223264:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427750.223272:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350939981056:12345-0@lo:13: 00002000:00000024:0.0:1789427750.223291:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789427750.223353:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350939981056:12345-0@lo:13: Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.223359:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789427750.223511:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bbd73800 x1876350939981056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.223526:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939981056:0@lo:13: 00000004:00080000:0.0:1789427750.223786:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789427750.224665:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939981312:0@lo:13: 00000100:00100000:0.0:1789427750.224705:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.224745:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981312 00000100:00100000:0.0:1789427750.224751:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981312 00000100:00100000:0.0:1789427750.224788:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427750.224794:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350939981312:12345-0@lo:13: 00002000:00000024:0.0:1789427750.224804:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789427750.224830:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350939981312:12345-0@lo:13: Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.224834:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789427750.224854:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789427750.224877:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad92a300 x1876350939981312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.224893:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939981312:0@lo:13: 00000004:00080000:0.0:1789427750.224910:0:8901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789427750.224929:0:8901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939981440:0@lo:7: 00000100:00100000:0.0:1789427750.224960:0:8901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.224979:0:8901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.225777:0:8402:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789427750.225785:0:8402:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789427750.226044:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981440 00000100:00100000:0.0:1789427750.226050:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981440 00000100:00100000:2.0:1789427750.226241:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427750.226250:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8901:x1876350939981440:12345-0@lo:7: 00002000:00080000:3.0:1789427750.227441:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789427750.227447:0:8401:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789427750.227513:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939981184:12345-0@lo:7: Request processed in 4347us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.227521:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789427750.227528:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bbd73480 x1876350939981184/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.227543:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981184:0@lo:7: 00000004:00080000:2.0:1789427750.227555:0:8894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789427750.227580:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981568:0@lo:5: 00000100:00100000:2.0:1789427750.227606:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.227641:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.227653:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981568 00000100:00100000:0.0:1789427750.227660:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981568 00000100:00100000:0.0:1789427750.227696:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789427750.227761:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939981568:12345-0@lo:5: 00002000:00080000:0.0:1789427750.227782:0:8400:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789427750.227828:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939981568:12345-0@lo:5: Request processed in 124us (221us total) trans 0 rc 0/0 00010000:00080000:2.0:1789427750.227837:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bbd73480 x1876350939981568/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.227837:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427750.227849:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981568:0@lo:5: 00000004:00080000:2.0:1789427750.227869:0:8894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789427750.227895:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981696:0@lo:5: 00000100:00100000:2.0:1789427750.227915:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.227931:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.227936:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981696 00000100:00100000:3.0:1789427750.227941:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981696 00000100:00100000:3.0:1789427750.227974:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789427750.227985:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8894:x1876350939981696:12345-0@lo:5: 00002000:00080000:3.0:1789427750.228010:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789427750.230444:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8894:x1876350939981696:12345-0@lo:5: Request processed in 2462us (2526us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789427750.230454:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789427750.230479:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bbd73480 x1876350939981696/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.230490:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8894:1876350939981696:0@lo:5: 00000004:00080000:0.0:1789427750.230500:0:8894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789427750.230525:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8894:1876350939981824:0@lo:900: 00000100:00100000:0.0:1789427750.230554:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.230574:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.230578:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981824 00000100:00100000:3.0:1789427750.230583:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981824 00000100:00100000:3.0:1789427750.230622:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427750.230627:0:6494:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1789427750.230633:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8894:x1876350939981824:12345-0@lo:900: 00000100:00100000:0.0:1789427750.230634:0:6494:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:3.0:1789427750.230680:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8894:x1876350939981824:12345-0@lo:900: Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.230695:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789427750.230729:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad929f80 x1876350939981824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427750.230740:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8894:1876350939981824:0@lo:900: 00002000:00080000:2.0:1789427750.233469:0:8902:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789427750.233475:0:8902:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789427750.233544:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8901:x1876350939981440:12345-0@lo:7: Request processed in 7294us (8581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.233553:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789427750.233574:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad92a300 x1876350939981440/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.233588:0:8901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939981440:0@lo:7: 00000004:00080000:1.0:1789427750.233601:0:8901:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789427750.233632:0:8901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939981952:0@lo:5: 00000100:00100000:1.0:1789427750.233669:0:8901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.233700:0:8901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.233707:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939981952 00000100:00100000:2.0:1789427750.233712:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939981952 00000100:00100000:2.0:1789427750.233758:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427750.233768:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8901:x1876350939981952:12345-0@lo:5: 00002000:00080000:2.0:1789427750.233786:0:8402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789427750.233790:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789427750.238885:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1789427750.238897:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789427750.238903:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789427750.239182:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8901:x1876350939981952:12345-0@lo:5: Request processed in 5414us (5508us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789427750.239192:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789427750.239211:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca29500 x1876350939981952/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.239225:0:8901:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789427750.239232:0:8901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939981952:0@lo:5: 00000004:00080000:1.0:1789427750.239246:0:8901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789427750.239285:0:8901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939982080:0@lo:700: 00000100:00100000:1.0:1789427750.239328:0:8901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.239362:0:8901:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.239517:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982080 00000100:00100000:2.0:1789427750.239524:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982080 00000100:00100000:2.0:1789427750.239562:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427750.239572:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8901:x1876350939982080:12345-0@lo:700: 00000100:00100000:0.0:1789427750.239583:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1789427750.239592:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:0.0:1789427750.245099:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8901:x1876350939982080:12345-0@lo:700: Request processed in 5523us (5775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.245112:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789427750.245126:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca29500 x1876350939982080/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.245142:0:8901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939982080:0@lo:700: 00000004:02000040:1.0:1789427750.247512:0:8901:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789427750.253269:0:8901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939982208:0@lo:5: 00000100:00100000:1.0:1789427750.253349:0:8901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.253404:0:8901:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.253640:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982208 00000100:00100000:3.0:1789427750.253648:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982208 00000100:00100000:3.0:1789427750.254230:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427750.254241:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8901:x1876350939982208:12345-0@lo:5: 00002000:00080000:3.0:1789427750.258170:0:8401:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789427750.258188:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789427750.262134:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8901:x1876350939982208:12345-0@lo:5: Request processed in 7889us (8779us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789427750.262147:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789427750.264512:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca29500 x1876350939982208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.264531:0:8901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8901:1876350939982208:0@lo:5: 00000004:00080000:0.0:1789427750.264545:0:8901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1789427750.320506:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427750.389500:0:8930:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427750.389676:0:8930:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789427750.875918:0:8978:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427750.875928:0:8978:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789427751.216671:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427751.216697:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939982336:0@lo:41: 00000100:00100000:0.0:1789427751.216754:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427751.216877:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982336 00000100:00100000:3.0:1789427751.216891:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982336 00000100:00100000:3.0:1789427751.216958:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427751.216971:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939982336:12345-0@lo:41: 00000004:00000024:3.0:1789427751.217016:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789427751.217572:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939982336:12345-0@lo:41: Request processed in 603us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427751.217582:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427751.217646:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939982336:0@lo:41: 00010000:00010000:1.0:1789427751.344586:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427752.368690:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427753.393584:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427753.776565:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939982464:0@lo:41: 00000100:00100000:2.0:1789427753.776643:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427753.776684:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982464 00000100:00100000:0.0:1789427753.776693:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982464 00000100:00100000:0.0:1789427753.776754:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427753.776765:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350939982464:12345-0@lo:41: 00000004:00000024:0.0:1789427753.776806:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789427753.776855:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350939982464:12345-0@lo:41: Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427753.776864:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427753.776890:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939982464:0@lo:41: 00010000:00010000:1.0:1789427754.417818:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789427755.127156:0:9476:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789427755.127159:0:9476:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789427755.127161:0:9476:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789427755.127294:0:9476:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196bcc8a000 00000020:01000004:1.0:1789427755.127306:0:9476:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789427755.127318:0:9476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789427755.127339:0:9476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91958302b380) 00000020:00000080:1.0:1789427755.127360:0:9476:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789427755.142410:0:9476:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789427755.142535:0:9476:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1789427755.154002:0:9476:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789427755.154717:0:9476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789427755.154730:0:9476:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789427755.154742:0:9476:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede518195 00000020:01000004:0.0:1789427755.154749:0:9476:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789427755.154773:0:9476:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789427755.154777:0:9476:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789427755.154783:0:9476:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789427755.154809:0:9476:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789427755.154814:0:9476:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789427755.171330:0:9476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789427755.171365:0:9476:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789427755.171369:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789427755.171371:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789427755.171373:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427755.171374:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427755.171376:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427755.171378:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427755.171380:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427755.171381:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427755.171383:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427755.171384:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427755.171386:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789427755.171389:0:9476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789427755.171392:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427755.171393:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789427755.171394:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427755.171395:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427755.171396:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427755.171398:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427755.171399:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427755.171400:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427755.171401:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427755.171402:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427755.171404:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789427755.171461:0:9476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789427755.171482:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939982592:0@lo:253: 00000100:00100000:0.0:1789427755.172141:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.172186:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb84180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427755.172267:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982592 00000100:00100000:1.0:1789427755.172288:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982592 00000100:00100000:1.0:1789427755.172344:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789427755.172355:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:9476:x1876350939982592:12345-0@lo:253: 20000000:01000000:1.0:1789427755.172385:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789427755.172390:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789427755.172395:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789427755.172399:0:6478:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789427755.172652:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427755.172778:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789427755.172797:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789427755.172829:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789427755.172839:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789427755.172855:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789427755.172878:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789427755.172986:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789427755.173003:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:1.0:1789427755.173005:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427755.173026:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789427755.173034:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427755.173054:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789427755.173062:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427755.173079:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789427755.173088:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789427755.173106:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789427755.173131:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789427755.173230:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789427755.173243:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:1.0:1789427755.173245:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427755.173283:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789427755.173291:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427755.173308:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789427755.173314:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427755.173327:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789427755.173332:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789427755.173344:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789427755.173367:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789427755.173748:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789427755.173760:0:6478:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:1.0:1789427755.173762:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:1.0:1789427755.173791:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789427755.173801:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789427755.173815:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789427755.173820:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:1.0:1789427755.173832:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789427755.173839:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789427755.173854:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789427755.173872:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789427755.173892:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789427755.173895:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789427755.173898:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789427755.173947:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789427755.173949:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789427755.174402:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1789427755.174456:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1789427755.174470:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789427755.174565:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789427755.174586:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789427755.174604:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789427755.174629:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789427755.174637:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789427755.175247:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789427755.175335:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789427755.175364:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789427755.175379:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789427755.175389:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789427755.175391:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789427755.175574:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789427755.175592:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789427755.175606:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789427755.175661:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789427755.175677:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789427755.175692:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789427755.175700:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789427755.175702:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789427755.176003:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789427755.176025:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789427755.176049:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789427755.176142:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789427755.176172:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789427755.176199:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789427755.176215:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789427755.176216:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789427755.181428:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789427755.181478:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789427755.181492:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789427755.181636:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789427755.181662:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789427755.181678:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1789427755.181694:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789427755.181713:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181730:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51808b expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181737:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181754:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181761:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518110 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181769:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51813a expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181775:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518156 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181781:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518180 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181788:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181836:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.181849:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 21 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.181862:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982720:0@lo:104: 00000100:00100000:0.0:1789427755.181967:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.182005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982720 00000100:00100000:1.0:1789427755.182013:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982720 00010000:00010000:0.0:1789427755.182018:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182028:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 21 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182043:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982848:0@lo:104: 00000100:00100000:1.0:1789427755.182070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427755.182071:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.182083:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939982720:12345-0@lo:104: 00010000:00010000:1.0:1789427755.182093:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182113:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182122:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 21 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182125:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982848 00000100:00100000:2.0:1789427755.182133:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982848 00000100:00100000:0.0:1789427755.182134:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982976:0@lo:104: 00010000:00010000:1.0:1789427755.182150:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427755.182157:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939982720:12345-0@lo:104: Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.182162:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427755.182168:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.182171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789427755.182177:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939982848:12345-0@lo:104: 00010000:00010000:2.0:1789427755.182187:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.182198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939982976 00010000:00010000:0.0:1789427755.182201:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.182202:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939982976 00010000:00010000:0.0:1789427755.182214:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 21 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.182221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427755.182226:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983104:0@lo:104: 00000100:00100000:1.0:1789427755.182229:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939982976:12345-0@lo:104: 00010000:00010000:2.0:1789427755.182235:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789427755.182237:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182244:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939982848:12345-0@lo:104: Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.182252:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427755.182257:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.182285:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983104 00000100:00100000:2.0:1789427755.182290:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983104 00010000:00010000:0.0:1789427755.182296:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182298:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789427755.182308:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789427755.182310:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939982976:12345-0@lo:104: Request processed in 80us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427755.182314:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 21 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182318:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939983104:12345-0@lo:104: 00000100:00100000:1.0:1789427755.182325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789427755.182333:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182334:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983232:0@lo:104: 00010000:00010000:1.0:1789427755.182362:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789427755.182368:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427755.182372:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.182380:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789427755.182382:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427755.182386:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182389:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939983104:12345-0@lo:104: Request processed in 72us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427755.182398:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182400:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789427755.182408:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427755.182429:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427755.182434:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789427755.182448:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983232 00000100:00100000:2.0:1789427755.182453:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983232 00010000:00010000:0.0:1789427755.182456:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 21 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182461:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182470:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427755.182474:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983360:0@lo:104: 00000100:00100000:2.0:1789427755.182485:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1789427755.182487:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182493:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede518180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518187 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182496:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939983232:12345-0@lo:104: 00010000:00010000:1.0:1789427755.182507:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789427755.182507:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427755.182509:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182512:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182524:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427755.182527:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182532:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427755.182536:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182539:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.182552:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:1.0:1789427755.182558:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427755.182558:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 21 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182563:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939983232:12345-0@lo:104: Request processed in 67us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427755.182575:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182577:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427755.182581:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983616:0@lo:104: 00010000:00010000:1.0:1789427755.182584:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427755.182592:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182598:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede518156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51815d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182601:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789427755.182605:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789427755.182608:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182611:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb84600 going to sleep for 11 seconds 00010000:00010000:1.0:1789427755.182612:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427755.182616:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182624:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427755.182625:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427755.182630:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182634:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982720:0@lo:104: 10000000:01000000:1.0:1789427755.182635:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789427755.182636:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983360 00000100:00100000:2.0:1789427755.182642:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983360 00010000:00010000:1.0:1789427755.182650:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182653:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982848:0@lo:104: 00010000:00010000:1.0:1789427755.182656:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789427755.182658:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983616 00000100:00100000:2.0:1789427755.182663:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983616 00000100:00100000:0.0:1789427755.182666:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939982976:0@lo:104: 00010000:00010000:1.0:1789427755.182675:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182679:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983104:0@lo:104: 00010000:00010000:1.0:1789427755.182683:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede51813a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518141 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182693:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789427755.182695:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427755.182695:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983232:0@lo:104: 00010000:00010000:1.0:1789427755.182696:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182707:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b707ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939983360:12345-0@lo:104: 00010000:00010000:2.0:1789427755.182718:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182720:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427755.182726:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182735:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427755.182743:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182744:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939983488:0@lo:103: 10000000:01000000:1.0:1789427755.182754:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427755.182755:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789427755.182763:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b707ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6478:x1876350939983360:12345-0@lo:104: Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.182769:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789427755.182776:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.182783:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427755.182788:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427755.182804:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182806:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427755.182812:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789427755.182814:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209400/0x84fc867ede518110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518117 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182819:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939983616:12345-0@lo:104: 00000100:00100000:0.0:1789427755.182822:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939983744:0@lo:103: 00010000:00010000:1.0:1789427755.182826:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427755.182831:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182834:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182844:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:0.0:1789427755.182848:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789427755.182850:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182866:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427755.182870:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427755.182874:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427755.182875:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427755.182881:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182888:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.182890:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789427755.182901:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6478:x1876350939983616:12345-0@lo:104: Request processed in 84us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427755.182906:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427755.182908:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813edc00 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:2.0:1789427755.182913:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:00010000:0.0:1789427755.182913:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182918:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.182929:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede5180f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180fb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182929:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.182930:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789427755.182947:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.182952:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983488 10000000:01000000:0.0:1789427755.182954:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427755.182955:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427755.182957:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983488 00010000:00010000:1.0:1789427755.182958:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427755.182963:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427755.182970:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789427755.182977:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 22 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.182978:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.182979:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939984128:0@lo:103: 00010000:00010000:0.0:1789427755.182996:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427755.183007:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183009:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.183010:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983744 00000100:00100000:2.0:1789427755.183015:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983744 00010000:00010000:0.0:1789427755.183021:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede5180b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180bc expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183029:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 23 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183033:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939984256:0@lo:103: 00010000:00010000:0.0:1789427755.183035:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427755.183038:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427755.183043:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427755.183051:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984128 00000100:00100000:2.0:1789427755.183055:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984128 00000100:00100000:1.0:1789427755.183066:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427755.183069:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 24 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.183086:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984256 00000100:00100000:0.0:1789427755.183090:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983360:0@lo:104: 00000100:00100000:2.0:1789427755.183091:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984256 00000100:00100000:1.0:1789427755.183094:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939983872:0@lo:103: 00010000:00010000:2.0:1789427755.183104:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 25 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.183109:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1876350939983616:0@lo:104: 00000100:00100000:2.0:1789427755.183129:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427755.183133:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.183142:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3615:x1876350939983488:12345-0@lo:103: 00010000:00010000:0.0:1789427755.183148:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183152:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427755.183153:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789427755.183161:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 25 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183163:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939984000:0@lo:103: 00010000:00010000:2.0:1789427755.183183:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 25 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183192:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427755.183201:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699964a00/0x84fc867ede518187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518180 expref: 25 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183215:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427755.183216:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939983872 00000100:00100000:0.0:1789427755.183222:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939983872 00000100:00100000:1.0:1789427755.183230:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984000 00000100:00100000:1.0:1789427755.183235:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984000 00010000:00010000:0.0:1789427755.183241:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 26 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183250:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 26 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.183251:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+26:3615:x1876350939983488:12345-0@lo:103: Request processed in 111us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.183262:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427755.183287:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+26:3615:x1876350939983744:12345-0@lo:103: 00010000:00010000:0.0:1789427755.183295:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427755.183300:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 26 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.183308:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 26 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.183318:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ed800/0x84fc867ede51815d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518156 expref: 26 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.183327:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427755.183343:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427755.183352:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3615:x1876350939983744:12345-0@lo:103: Request processed in 80us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.183360:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427755.183371:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350939984128:12345-0@lo:103: 00010000:00010000:2.0:1789427755.183378:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427755.183382:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 24 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183390:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 24 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183400:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699964400/0x84fc867ede5180fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5180f4 expref: 24 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183409:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427755.183455:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789427755.183462:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688834450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3616:x1876350939984256:12345-0@lo:103: 00010000:00010000:1.0:1789427755.183468:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427755.183472:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 23 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183479:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 23 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183487:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965000/0x84fc867ede5180bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5180b5 expref: 23 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183494:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427755.183520:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688834450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3616:x1876350939984256:12345-0@lo:103: Request processed in 60us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.183525:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789427755.183535:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789427755.183540:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3613:x1876350939983872:12345-0@lo:103: 00010000:00010000:1.0:1789427755.183551:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789427755.183553:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3616:x1876350939984128:12345-0@lo:103: Request processed in 185us (545us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427755.183557:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 21 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.183565:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789427755.183567:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 21 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183576:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ed200/0x84fc867ede518141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51813a expref: 20 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.183583:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427755.183584:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789427755.183593:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350939984000:12345-0@lo:103: 00010000:00010000:2.0:1789427755.183607:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427755.183610:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350939983872:12345-0@lo:103: Request processed in 68us (482us total) trans 0 rc 0/0 00010000:00010000:2.0:1789427755.183615:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 19 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183618:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789427755.183631:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 18 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183643:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9e00/0x84fc867ede518117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518110 expref: 18 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183651:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939984256:0@lo:103: 00010000:00010000:2.0:1789427755.183653:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427755.183659:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350939984128:0@lo:103: 00000100:00100000:1.0:1789427755.183680:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939984000:0@lo:103: 00000100:00100000:2.0:1789427755.183686:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3613:x1876350939984000:12345-0@lo:103: Request processed in 92us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.183690:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939983872:0@lo:103: 00000100:00100000:2.0:1789427755.183697:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789427755.183834:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427755.183835:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939983744:0@lo:103: 00010000:00010000:2.0:1789427755.183840:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183845:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939983488:0@lo:103: 00010000:00010000:2.0:1789427755.183853:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427755.183857:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183866:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427755.183873:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427755.183878:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427755.183901:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183912:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427755.183928:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.183929:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939984384:0@lo:103: 00010000:00010000:2.0:1789427755.183941:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede51808b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518092 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.183953:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.183955:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.183957:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.183964:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.183965:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427755.184009:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.184126:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427755.184179:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984384 00000100:00100000:0.0:1789427755.184183:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984384 00010000:00010000:0.0:1789427755.184199:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 16 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.184230:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427755.184238:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3613:x1876350939984384:12345-0@lo:103: 00010000:00010000:0.0:1789427755.184253:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427755.184258:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 16 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184268:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 16 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184293:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965c00/0x84fc867ede518092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51808b expref: 16 pid: 6478 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184303:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184311:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184322:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184329:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184335:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184341:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184345:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427755.184349:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184363:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184380:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.184388:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427755.184397:0:6478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.184407:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.184436:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3613:x1876350939984384:12345-0@lo:103: Request processed in 200us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.184444:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789427755.184470:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209600/0x84fc867ede51819c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789427755.184483:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789427755.184840:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350939984384:0@lo:103: 00000100:00100000:2.0:1789427755.185922:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:9476:x1876350939982592:12345-0@lo:253: Request processed in 13569us (13780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.185930:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789427755.185977:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939982592:0@lo:253: 10000000:01000000:0.0:1789427755.185986:0:9476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789427755.185990:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789427755.185991:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789427755.185993:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427755.185994:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789427755.185996:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427755.185997:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427755.185998:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427755.186000:0:9476:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789427755.186001:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427755.186002:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789427755.186015:0:9476:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bcc8a000 from lustre-OST0001 10000000:01000000:0.0:1789427755.186034:0:9476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789427755.186037:0:9476:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789427755.186043:0:9476:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688454d40 local copy 10000000:01000000:0.0:1789427755.186046:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789427755.186065:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.186074:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.186088:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.186099:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984512:0@lo:101: 00000100:00100000:0.0:1789427755.186123:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.186175:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb84840 going to sleep for 11 seconds 00000100:00100000:2.0:1789427755.186203:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984512 00000100:00100000:2.0:1789427755.186207:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984512 00000100:00100000:2.0:1789427755.186260:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789427755.186267:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+14:9476:x1876350939984512:12345-0@lo:101: 00010000:00010000:2.0:1789427755.186296:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427755.186307:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9400/0x84fc867ede5181aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5181a3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.186324:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9400/0x84fc867ede5181aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5181a3 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.186334:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9400/0x84fc867ede5181aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181a3 expref: 15 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.186341:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9400, rc 0) 00000100:00100000:2.0:1789427755.186375:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939984512:12345-0@lo:101: Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.186381:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789427755.186589:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984512:0@lo:101: 00010000:00010000:3.0:1789427755.186600:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.186608:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427755.186676:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984640:0@lo:501: 00000100:00100000:3.0:1789427755.186699:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.186792:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.186815:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984640 00000100:00100000:0.0:1789427755.186819:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984640 00000100:00100000:0.0:1789427755.186837:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789427755.186842:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939984640:12345-0@lo:501: 00000100:00100000:0.0:1789427755.186889:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939984640:12345-0@lo:501: Request processed in 46us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427755.186895:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789427755.186961:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984640:0@lo:501: 10000000:01000000:3.0:1789427755.186972:0:9476:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789427755.186986:0:9476:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789427755.186991:0:9476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.186999:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.187006:0:9476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.187049:0:9476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789427755.187066:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196bcc8a000 10000000:01000000:3.0:1789427755.187070:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789427755.187074:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789427755.187081:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427755.187085:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789427755.187087:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789427755.187099:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.187107:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.187114:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427755.187124:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984768:0@lo:101: 00000100:00100000:3.0:1789427755.187146:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.187165:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427755.187204:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984768 00000100:00100000:2.0:1789427755.187208:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984768 00000100:00100000:2.0:1789427755.187232:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789427755.187238:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939984768:12345-0@lo:101: 00010000:00010000:2.0:1789427755.187244:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427755.187250:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5181b1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.187263:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.187282:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.187289:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9800, rc 0) 00000100:00100000:2.0:1789427755.187318:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939984768:12345-0@lo:101: Request processed in 80us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.187324:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789427755.187376:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984768:0@lo:101: 00010000:00010000:3.0:1789427755.187385:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427755.187393:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427755.187460:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984896:0@lo:501: 00000100:00100000:3.0:1789427755.187482:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.187497:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.187510:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939984896 00000100:00100000:3.0:1789427755.187514:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939984896 00000100:00100000:3.0:1789427755.187544:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789427755.187552:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939984896:12345-0@lo:501: 00000100:00100000:3.0:1789427755.187698:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939984896:12345-0@lo:501: Request processed in 148us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.187705:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789427755.187764:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939984896:0@lo:501: 00000100:00100000:2.0:1789427755.187800:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985024:0@lo:503: 00000100:00100000:2.0:1789427755.187830:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.187852:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.187899:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985024 00000100:00100000:3.0:1789427755.187903:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985024 00010000:00010000:0.0:1789427755.187984:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427755.187990:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.187998:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427755.188003:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.188011:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427755.188019:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427755.188025:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427755.188046:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.188052:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427755.188069:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.188076:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede5181a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x84fc867ede5181aa expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.188087:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427755.188089:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427755.188092:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427755.188094:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939985152:0@lo:103: 00000100:00100000:2.0:1789427755.188121:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789427755.188131:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985024:12345-0@lo:503: 00000100:00100000:1.0:1789427755.188135:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.188232:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985152 00000100:00100000:0.0:1789427755.188239:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985152 00000100:00100000:0.0:1789427755.188268:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427755.188285:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3614:x1876350939985152:12345-0@lo:103: 00010000:00010000:0.0:1789427755.188293:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427755.188301:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9400/0x84fc867ede5181aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5181a3 expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.188311:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427755.188341:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:3614:x1876350939985152:12345-0@lo:103: Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.188346:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427755.188388:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985024:12345-0@lo:503: Request processed in 259us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.188390:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985024:0@lo:503: 00000100:00100000:2.0:1789427755.188402:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789427755.188473:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350939985152:0@lo:103: 00000040:00080000:1.0:1789427755.188906:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427755.188959:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985280:0@lo:502: 00000100:00100000:1.0:1789427755.188993:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.189016:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.189025:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985280 00000100:00100000:3.0:1789427755.189030:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985280 00000100:00100000:3.0:1789427755.189088:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789427755.189095:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985280:12345-0@lo:502: 00000100:00100000:3.0:1789427755.189163:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985280:12345-0@lo:502: Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.189170:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789427755.189484:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985280:0@lo:502: 00000040:00080000:1.0:1789427755.189963:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789427755.189989:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789427755.190005:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789427755.190019:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789427755.190034:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789427755.190047:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789427755.190067:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985408:0@lo:502: 00000100:00100000:1.0:1789427755.190103:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.190128:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.190137:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985408 00000100:00100000:3.0:1789427755.190143:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985408 00000100:00100000:3.0:1789427755.190171:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789427755.190177:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985408:12345-0@lo:502: 00000100:00100000:3.0:1789427755.190239:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985408:12345-0@lo:502: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.190244:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789427755.190299:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985408:0@lo:502: 00000040:00080000:1.0:1789427755.190336:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789427755.190344:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789427755.190784:0:9488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789427755.190791:0:9488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789427755.190796:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.190798:0:9488:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789427755.190803:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427755.190814:0:9488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff919583028000) 00000020:00000080:1.0:1789427755.190834:0:9488:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789427755.190839:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789427755.190893:0:9488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789427755.190905:0:9488:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789427755.190910:0:9488:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede5181c6 00010000:00010000:1.0:1789427755.194636:0:9488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789427755.194866:0:9488:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789427755.196798:0:9488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789427755.197042:0:9488:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789427755.199989:0:9488:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789427755.200139:0:9488:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789427755.203249:0:9488:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789427755.204061:0:9488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789427755.204070:0:9488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427755.204075:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.204077:0:9488:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789427755.204081:0:9488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427755.204084:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.204085:0:9488:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427755.204088:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427755.204090:0:9488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427755.204102:0:9488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427755.204105:0:9488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.204106:0:9488:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789427755.204109:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789427755.204180:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789427755.204221:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789427755.204241:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.204252:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427755.204259:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8a000 from 1 10000000:01000000:2.0:1789427755.204262:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427755.204304:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.204313:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.204335:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.204357:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985536:0@lo:101: 00000100:00100000:2.0:1789427755.204438:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.204492:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.204660:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985536 00000100:00100000:0.0:1789427755.204669:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985536 00000100:00100000:0.0:1789427755.204931:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789427755.204942:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:9476:x1876350939985536:12345-0@lo:101: 00010000:00010000:0.0:1789427755.204964:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427755.204977:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5181cd expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.205001:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5181cd expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.205011:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181cd expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.205019:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208400, rc 0) 00000100:00100000:0.0:1789427755.205068:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985536:12345-0@lo:101: Request processed in 128us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.205076:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789427755.205111:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985536:0@lo:101: 00010000:00010000:2.0:1789427755.205137:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.205149:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.205237:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985664:0@lo:501: 00000100:00100000:2.0:1789427755.205313:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.205343:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.205458:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985664 00000100:00100000:0.0:1789427755.205464:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985664 00000100:00100000:0.0:1789427755.205496:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789427755.205506:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985664:12345-0@lo:501: 00000100:00100000:0.0:1789427755.205595:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985664:12345-0@lo:501: Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.205603:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789427755.205621:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985664:0@lo:501: 00000100:00100000:1.0:1789427755.205652:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985792:0@lo:503: 00000100:00100000:1.0:1789427755.205691:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.205716:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196832833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.206083:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985792 00000100:00100000:0.0:1789427755.206089:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985792 00000100:00100000:0.0:1789427755.206119:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789427755.206127:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985792:12345-0@lo:503: 00000100:00100000:0.0:1789427755.206208:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985792:12345-0@lo:503: Request processed in 82us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.206216:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789427755.206230:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985792:0@lo:503: 00000040:00080000:1.0:1789427755.206405:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427755.206478:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985920:0@lo:502: 00000100:00100000:1.0:1789427755.206514:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.206551:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.206564:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939985920 00000100:00100000:0.0:1789427755.206570:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939985920 00000100:00100000:0.0:1789427755.206600:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789427755.206609:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985920:12345-0@lo:502: 00000100:00100000:0.0:1789427755.206692:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939985920:12345-0@lo:502: Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.206702:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939985920:0@lo:502: 00000100:00100000:0.0:1789427755.206702:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000040:00080000:1.0:1789427755.206865:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789427755.206888:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789427755.206903:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986048:0@lo:502: 00000100:00100000:1.0:1789427755.206934:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.206950:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.206980:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986048 00000100:00100000:0.0:1789427755.206985:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986048 00000100:00100000:0.0:1789427755.207021:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789427755.207030:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939986048:12345-0@lo:502: 00000100:00100000:0.0:1789427755.207103:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939986048:12345-0@lo:502: Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.207110:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789427755.207113:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986048:0@lo:502: 00000040:00080000:1.0:1789427755.207157:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789427755.207166:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789427755.207490:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427755.207497:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.207499:0:9492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789427755.207505:0:9492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bcc8a000 00000020:00000080:1.0:1789427755.207508:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789427755.207517:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427755.207520:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427755.207521:0:9492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789427755.207524:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789427755.207627:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789427755.207647:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427755.207686:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207698:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427755.207746:0:9476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789427755.207749:0:9476:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196bcc8a000 10000000:01000000:0.0:1789427755.207752:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196bcc8a000 10000000:01000000:0.0:1789427755.207756:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789427755.207760:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bcc8a000 from 1 10000000:01000000:0.0:1789427755.207763:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427755.207780:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207792:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207802:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.207814:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986176:0@lo:101: 00000100:00100000:0.0:1789427755.207843:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.207866:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427755.207881:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986176 00000100:00100000:0.0:1789427755.207885:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986176 00000100:00100000:0.0:1789427755.207913:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789427755.207920:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9476:x1876350939986176:12345-0@lo:101: 00010000:00010000:0.0:1789427755.207928:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427755.207937:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5181db expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207954:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5181db expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207963:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181db expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.207971:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209e00, rc 0) 00000100:00100000:0.0:1789427755.207997:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986176:12345-0@lo:101: Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.208003:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789427755.208033:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986176:0@lo:101: 00010000:00010000:0.0:1789427755.208051:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.208060:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427755.208116:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986304:0@lo:501: 00000100:00100000:0.0:1789427755.208142:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.208170:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.208561:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986304 00000100:00100000:3.0:1789427755.208566:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986304 00000100:00100000:3.0:1789427755.208593:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789427755.208599:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986304:12345-0@lo:501: 00000100:00100000:3.0:1789427755.208662:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986304:12345-0@lo:501: Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.208668:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789427755.208742:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986304:0@lo:501: 00000100:00100000:0.0:1789427755.208763:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986432:0@lo:503: 00000100:00100000:0.0:1789427755.208791:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.208816:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427755.208837:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986432 00000100:00100000:2.0:1789427755.208843:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986432 00000100:00100000:2.0:1789427755.208877:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789427755.208886:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986432:12345-0@lo:503: 00000100:00100000:2.0:1789427755.208960:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986432:12345-0@lo:503: Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.208968:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789427755.208980:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986432:0@lo:503: 00000040:00080000:0.0:1789427755.209112:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789427755.209155:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986560:0@lo:502: 00000100:00100000:0.0:1789427755.209183:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.209229:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427755.209255:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986560 00000100:00100000:1.0:1789427755.209259:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986560 00000100:00100000:1.0:1789427755.209294:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789427755.209301:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986560:12345-0@lo:502: 00000100:00100000:1.0:1789427755.209394:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986560:12345-0@lo:502: Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.209400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789427755.209544:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986560:0@lo:502: 00000040:00080000:0.0:1789427755.209663:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789427755.209683:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789427755.209695:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789427755.209707:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789427755.209719:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789427755.209730:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789427755.209742:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789427755.209753:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789427755.209771:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789427755.209783:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789427755.209794:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789427755.209805:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789427755.209816:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789427755.209828:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789427755.209839:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789427755.209850:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789427755.209861:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789427755.209873:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789427755.209884:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789427755.209896:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789427755.209907:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789427755.209918:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789427755.209929:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789427755.209949:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789427755.209961:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789427755.209972:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789427755.209983:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789427755.209994:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789427755.210005:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789427755.210016:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789427755.210027:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789427755.210038:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789427755.210049:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789427755.210060:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789427755.210071:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789427755.210083:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789427755.210094:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789427755.210105:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789427755.210116:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789427755.210137:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789427755.210151:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789427755.210169:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789427755.210181:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789427755.210192:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789427755.210203:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789427755.210214:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789427755.210229:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986688:0@lo:502: 00000100:00100000:0.0:1789427755.210256:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.210291:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986688 00000100:00100000:0.0:1789427755.210294:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427755.210295:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986688 00000100:00100000:2.0:1789427755.210323:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789427755.210328:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986688:12345-0@lo:502: 00000100:00100000:2.0:1789427755.210388:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939986688:12345-0@lo:502: Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.210392:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789427755.210523:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939986688:0@lo:502: 00000040:00080000:0.0:1789427755.210555:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789427755.210561:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789427755.210824:0:9493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789427755.210840:0:9493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9196bf98cd40) 00000020:00000080:3.0:1789427755.210857:0:9493:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789427755.210926:0:9493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789427755.210930:0:9493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bcc8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789427755.210932:0:9493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8a000 3 00010000:00080000:3.0:1789427755.210955:0:9493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bca84800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789427755.213000:0:9493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789427755.213164:0:9493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789427755.213199:0:9493:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789427755.213207:0:9493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x84fc867ede5181f0 00000100:00080000:2.0:1789427755.213214:0:9493:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427755.213222:0:9493:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9196bca84800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427755.213246:0:9493:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bbd72d80 x1876350939986816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427755.213282:0:9493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789427755.214539:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350939986816:0@lo:38: 00000100:00100000:3.0:1789427755.214621:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789427755.214734:0:9493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789427755.214744:0:9493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9196bf9899c0) 00000020:00000080:3.0:1789427755.214759:0:9493:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789427755.214840:0:9493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789427755.214843:0:9493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bcc8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789427755.214847:0:9493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8a000 3 00010000:00080000:3.0:1789427755.214875:0:9493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bca83000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.124@tcp at head 00000100:00100000:0.0:1789427755.215338:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986816 00000100:00100000:0.0:1789427755.215345:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986816 00000100:00100000:0.0:1789427755.215385:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427755.215394:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350939986816:12345-0@lo:38: 00010000:00080000:0.0:1789427755.215445:0:8108:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 99 last 0 00000100:00100000:1.0:1789427755.215463:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350939986944:0@lo:400: 00000020:00000080:0.0:1789427755.215484:0:8108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x84fc867ede5181fe 00000004:00100000:0.0:1789427755.215501:0:8108:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1789427755.215520:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789427755.215534:0:8108:0:(import.c:65:import_set_state_nolock()) ffff919583219800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427755.215552:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350939987456:0@lo:400: 00000100:00100000:1.0:1789427755.215585:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.215602:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3612:x1876350939986816:12345-0@lo:38: Request processed in 207us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.215613:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427755.215614:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789427755.215624:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939987072:0@lo:400: 00000100:00100000:0.0:1789427755.215632:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939986944 00000100:00100000:0.0:1789427755.215637:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939986944 00000100:00100000:1.0:1789427755.215655:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.215664:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987456 00000100:00100000:0.0:1789427755.215668:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987456 00000100:00100000:1.0:1789427755.215679:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350939987584:0@lo:400: 00000100:00100000:1.0:1789427755.215713:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.215742:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350939987200:0@lo:400: 00000100:00100000:0.0:1789427755.215767:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427755.215777:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350939986944:12345-0@lo:400: 00000100:00100000:0.0:1789427755.215831:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350939986944:12345-0@lo:400: Request processed in 55us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.215838:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427755.215854:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987584 00000100:00100000:0.0:1789427755.215858:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987584 00000100:00100000:0.0:1789427755.215890:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427755.215899:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350939987456:12345-0@lo:400: 00000100:00100000:0.0:1789427755.215933:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350939987456:12345-0@lo:400: Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.215939:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427755.215952:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427755.215958:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350939987584:12345-0@lo:400: 00000100:00100000:0.0:1789427755.215992:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350939987584:12345-0@lo:400: Request processed in 36us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.215998:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789427755.216016:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427755.216019:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427755.216051:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939987328:0@lo:400: 00000100:00100000:0.0:1789427755.216081:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.216108:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987072 00000100:00100000:0.0:1789427755.216108:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939987840:0@lo:400: 00000100:00100000:2.0:1789427755.216114:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987072 00000100:00100000:0.0:1789427755.216139:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.216148:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987328 00000100:00100000:2.0:1789427755.216152:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987328 00000100:00100000:2.0:1789427755.216173:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789427755.216183:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939987072:12345-0@lo:400: 00000100:00100000:0.0:1789427755.216186:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427755.216199:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350939987328:12345-0@lo:400: 00000100:00100000:2.0:1789427755.216229:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939987072:12345-0@lo:400: Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.216236:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427755.216259:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350939987328:12345-0@lo:400: Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.216267:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427755.216325:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939987328:0@lo:400: 00000100:00100000:0.0:1789427755.216361:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939987072:0@lo:400: 00000100:00100000:1.0:1789427755.216374:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427755.216380:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca29c00 x1876350939987584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.216392:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350939987584:0@lo:400: 00010000:00080000:0.0:1789427755.216409:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca28e00 x1876350939986944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.216442:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350939986944:0@lo:400: 00010000:00080000:0.0:1789427755.216459:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca2b100 x1876350939987456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.216468:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350939987456:0@lo:400: 00000100:00100000:0.0:1789427755.216500:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987200 00000100:00100000:0.0:1789427755.216504:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987200 00000100:00100000:0.0:1789427755.216529:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427755.216535:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350939987200:12345-0@lo:400: 00000100:00100000:0.0:1789427755.216567:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350939987200:12345-0@lo:400: Request processed in 33us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.216587:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789427755.216671:0:9494:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9195831bd500 x1876350939987968/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.216678:0:9494:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886da80 going to sleep for 0 seconds 00010000:00080000:1.0:1789427755.216733:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca2aa00 x1876350939987200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427755.216744:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350939987200:0@lo:400: 00000100:00100000:1.0:1789427755.216750:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939987712:0@lo:400: 00000100:00100000:1.0:1789427755.216782:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427755.216873:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987840 00000100:00100000:0.0:1789427755.216879:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987840 00010000:00010000:3.0:1789427755.216889:0:9493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:0.0:1789427755.216967:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987712 00000100:00100000:0.0:1789427755.216970:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987712 00000100:00100000:0.0:1789427755.217002:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427755.217008:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350939987840:12345-0@lo:400: 00000100:00080000:1.0:1789427755.217027:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427755.217045:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350939987840:12345-0@lo:400: Request processed in 38us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.217052:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427755.217059:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427755.217068:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939987712:12345-0@lo:400: 00000020:00000080:3.0:1789427755.217073:0:9493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00010000:00080000:0.0:1789427755.217086:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919688822a00 x1876350939987840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.217093:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939987840:0@lo:400: 00000010:01000000:3.0:1789427755.217108:0:9493:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789427755.217119:0:9493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x84fc867ede518205 00000100:00080000:3.0:1789427755.217127:0:9493:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00100000:1.0:1789427755.217127:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939987712:12345-0@lo:400: Request processed in 64us (343us total) trans 0 rc 0/0 00010000:00080000:0.0:1789427755.217134:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bbd72d80 x1876350939986816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789427755.217140:0:9493:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9196bca83000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427755.217143:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427755.217151:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789427755.217156:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789427755.217162:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1789427755.217165:0:9493:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919581dbd880 x1876350939988096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427755.217166:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789427755.217170:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789427755.217179:0:3612:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000013f4d5ac): req@ffff9195831bd500 x1876350939987968/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789427755.217183:0:9493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:1.0:1789427755.217190:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919688821880 x1876350939987712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.217195:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350939986816:0@lo:38: 00000100:00100000:1.0:1789427755.217207:0:3613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789427755.217225:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939987712:0@lo:400: 00000100:00100000:0.0:1789427755.217260:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350939988096:0@lo:38: 00000100:00100000:0.0:1789427755.217302:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.217345:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988096 00000100:00100000:0.0:1789427755.217354:0:9494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.217358:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988096 00000100:00100000:0.0:1789427755.217373:0:9494:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427755.217378:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939987968 00000100:00100000:3.0:1789427755.217384:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939987968 00000100:00100000:1.0:1789427755.217394:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427755.217401:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350939988096:12345-0@lo:38: 00000100:00080000:0.0:1789427755.217435:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427755.217450:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789427755.217451:0:6483:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 99 last 0 00000100:00100000:3.0:1789427755.217462:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9494:x1876350939987968:12345-0@lo:901: 00000020:00000080:1.0:1789427755.217484:0:6483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x84fc867ede51820c 00000004:00100000:1.0:1789427755.217496:0:6483:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789427755.217526:0:6483:0:(import.c:65:import_set_state_nolock()) ffff91958343f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427755.217564:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9494:x1876350939987968:12345-0@lo:901: Request processed in 103us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.217571:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789427755.217579:0:9494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9195831bd500 x1876350939987968/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789427771 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427755.217588:0:9494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9494:1876350939987968:0@lo:901: 00000100:00100000:1.0:1789427755.217589:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3612:x1876350939988096:12345-0@lo:38: Request processed in 183us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.217605:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789427755.217655:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919581dbd880 x1876350939988096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:3.0:1789427755.217660:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:1.0:1789427755.217665:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427755.217672:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789427755.217679:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789427755.217683:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789427755.217686:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca83000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427755.217693:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350939988096:0@lo:38: 00000020:01000000:1.0:1789427755.217732:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789427755.217768:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427755.217784:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.217796:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789427755.217840:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789427755.217847:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427755.217848:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427755.217850:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427755.217851:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427755.217853:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427755.217855:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427755.217856:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427755.217858:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427755.217860:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427755.217861:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427755.217864:0:9476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789427755.217867:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427755.217869:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427755.217870:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427755.217871:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427755.217873:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427755.217874:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427755.217875:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427755.217877:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427755.217878:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427755.217879:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427755.217880:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427755.217895:0:9476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789427755.217905:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939988224:0@lo:253: 00000100:00100000:1.0:1789427755.217942:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.217970:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427755.217988:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988224 00000100:00100000:1.0:1789427755.217993:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988224 00000100:00100000:1.0:1789427755.218038:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427755.218047:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939988224:12345-0@lo:253: 20000000:01000000:1.0:1789427755.218066:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789427755.218082:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789427755.220838:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789427755.220849:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789427755.220862:0:6498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789427755.220868:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789427755.220903:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.220922:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518102 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.220943:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518148 expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.220952:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.220984:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.220999:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 17 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.221013:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939988352:0@lo:104: 00000100:00100000:2.0:1789427755.221055:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427755.221080:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9476:x1876350939988224:12345-0@lo:253: Request processed in 3034us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.221098:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:2.0:1789427755.221103:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221115:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 17 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.221126:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939988480:0@lo:104: 00000100:00100000:2.0:1789427755.221172:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.221201:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9476:1876350939988224:0@lo:253: 00000100:00100000:2.0:1789427755.221202:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509480 going to sleep for 11 seconds 10000000:01000000:3.0:1789427755.221217:0:9476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789427755.221221:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789427755.221223:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789427755.221226:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427755.221228:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:2.0:1789427755.221228:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988352 00000020:01000004:3.0:1789427755.221230:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427755.221233:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427755.221234:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1789427755.221235:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988352 00000020:01000004:3.0:1789427755.221236:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789427755.221238:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789427755.221240:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427755.221241:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789427755.221254:0:9476:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789427755.221283:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988480 00000100:00100000:2.0:1789427755.221288:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988480 00000100:00100000:2.0:1789427755.221318:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427755.221327:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939988352:12345-0@lo:104: 00010000:00010000:2.0:1789427755.221353:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221401:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789427755.221408:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:6498:x1876350939988352:12345-0@lo:104: Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.221437:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427755.221456:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789427755.221463:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939988480:12345-0@lo:104: 00010000:00010000:2.0:1789427755.221473:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221513:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789427755.221518:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:6498:x1876350939988480:12345-0@lo:104: Request processed in 57us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.221526:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789427755.221548:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427755.221555:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221563:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427755.221567:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221577:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427755.221584:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427755.221597:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427755.221626:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221632:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427755.221651:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221659:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede518148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51814f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221672:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427755.221675:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221681:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427755.221684:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221691:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427755.221697:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427755.221702:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427755.221716:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221721:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427755.221734:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221741:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede518102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518109 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.221756:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.221759:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.221761:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427755.221769:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427755.221780:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939988608:0@lo:103: 00000100:00100000:2.0:1789427755.221811:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.221846:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427755.221853:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939988736:0@lo:103: 00000100:00100000:1.0:1789427755.221875:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988608 00000100:00100000:1.0:1789427755.221881:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988608 00000100:00100000:2.0:1789427755.221882:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427755.221904:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 17 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.221919:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988736 00000100:00100000:2.0:1789427755.221925:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988736 00000100:00100000:1.0:1789427755.221937:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789427755.221945:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 18 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.221947:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3615:x1876350939988608:12345-0@lo:103: 00010000:00010000:1.0:1789427755.221963:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427755.221970:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 18 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427755.221985:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 18 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.221987:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789427755.222001:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3615:x1876350939988736:12345-0@lo:103: 00010000:00010000:1.0:1789427755.222004:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427755.222023:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427755.222030:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 18 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.222039:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3615:x1876350939988608:12345-0@lo:103: Request processed in 94us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1789427755.222045:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 18 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427755.222049:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789427755.222067:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222082:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789427755.222096:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002603976s 00000100:00100000:1.0:1789427755.222101:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939988608:0@lo:103: 00010000:00010000:2.0:1789427755.222102:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222114:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222122:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222130:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222136:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427755.222140:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222147:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222156:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222165:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427755.222205:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3615:x1876350939988736:12345-0@lo:103: Request processed in 209us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.222213:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789427755.222231:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939988736:0@lo:103: 00010000:00010000:2.0:1789427755.222258:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209a00/0x84fc867ede51814f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518148 expref: 16 pid: 6475 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.222269:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939988352:0@lo:104: 00010000:00010000:2.0:1789427755.222294:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e8e00/0x84fc867ede518109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518102 expref: 15 pid: 6477 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427755.222303:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6498:1876350939988480:0@lo:104: 00010000:00010000:2.0:1789427755.222317:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222327:0:6498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222333:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427755.222340:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9000/0x84fc867ede518213 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789427755.224802:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789427755.224938:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789427755.225096:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789427755.225225:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789427755.225448:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789427755.225689:0:9476:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789427755.227058:0:9476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789427755.232380:0:9476:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789427755.232388:0:9476:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789427755.232587:0:9476:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789427755.232626:0:9476:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789427755.232647:0:9476:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789427755.232664:0:9476:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789427755.233660:0:9476:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427755.233860:0:9476:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1789427755.312736:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427755.312757:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939988864:0@lo:13: 00000100:00100000:0.0:1789427755.312819:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.313211:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988864 00000100:00100000:1.0:1789427755.313222:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427755.313224:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988864 00000100:00100000:1.0:1789427755.313234:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939988992:0@lo:13: 00000100:00100000:1.0:1789427755.313267:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.313290:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427755.313300:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350939988864:12345-0@lo:13: 00002000:00000024:2.0:1789427755.313326:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427755.313377:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350939988864:12345-0@lo:13: Request processed in 78us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.313384:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427755.313400:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939988992 00000100:00100000:2.0:1789427755.313403:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939988992 00000100:00100000:2.0:1789427755.313437:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427755.313444:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939988992:12345-0@lo:13: 00002000:00000024:2.0:1789427755.313453:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427755.313482:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939988992:12345-0@lo:13: Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.313489:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789427755.313680:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361e680 x1876350939988992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789427755.313688:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9195831bd500 x1876350939988864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427755.313705:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939988992:0@lo:13: 00000100:00100000:0.0:1789427755.313708:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939988864:0@lo:13: 00010000:00010000:2.0:1789427755.440510:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427755.664200:0:9550:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427755.664400:0:9550:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789427756.336618:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427756.336642:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939989120:0@lo:41: 00000100:00100000:0.0:1789427756.336712:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427756.336753:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989120 00000100:00100000:1.0:1789427756.336761:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989120 00000100:00100000:1.0:1789427756.336807:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427756.336817:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939989120:12345-0@lo:41: 00000004:00000024:1.0:1789427756.336847:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789427756.336897:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939989120:12345-0@lo:41: Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427756.336903:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427756.336949:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939989120:0@lo:41: 00000001:00080000:3.0:1789427756.338153:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1789427756.464794:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427757.489559:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427758.211610:0:9839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789427758.512514:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789427758.673704:0:9892:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427758.673895:0:9892:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789427758.896901:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939989248:0@lo:41: 00000100:00100000:1.0:1789427758.896967:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427758.897345:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989248 00000100:00100000:3.0:1789427758.897359:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989248 00000100:00100000:3.0:1789427758.897661:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427758.897673:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939989248:12345-0@lo:41: 00000004:00000024:3.0:1789427758.897731:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789427758.897826:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939989248:12345-0@lo:41: Request processed in 155us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427758.897853:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427758.898266:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939989248:0@lo:41: 10000000:01000000:1.0:1789427759.088537:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789427759.088547:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bc9e1800 from 39 10000000:01000000:1.0:1789427759.088552:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789427759.088604:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.088617:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.088630:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.088656:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989376:0@lo:101: 00000100:00100000:1.0:1789427759.088734:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.088786:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.088896:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989376 00000100:00100000:2.0:1789427759.088905:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989376 00000100:00100000:2.0:1789427759.088967:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789427759.088977:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350939989376:12345-0@lo:101: 00010000:00010000:2.0:1789427759.088991:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.089006:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51821a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.089031:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51821a expref: 16 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.089055:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51821a expref: 16 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.089065:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9200, rc 0) 00000100:00100000:2.0:1789427759.089117:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939989376:12345-0@lo:101: Request processed in 142us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.089124:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789427759.089256:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989376:0@lo:101: 00010000:00010000:3.0:1789427759.089272:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.089282:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.089353:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989504:0@lo:501: 00000100:00100000:3.0:1789427759.089380:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.089394:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427759.089536:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989504 00000100:00100000:1.0:1789427759.089541:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989504 00000100:00100000:1.0:1789427759.089571:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789427759.089578:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939989504:12345-0@lo:501: 00000100:00100000:1.0:1789427759.089702:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939989504:12345-0@lo:501: Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.089709:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789427759.089741:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989504:0@lo:501: 00000100:00100000:1.0:1789427759.089768:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989632:0@lo:503: 00000100:00100000:1.0:1789427759.089807:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.089824:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427759.089833:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989632 00000100:00100000:1.0:1789427759.089836:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989632 00000100:00100000:1.0:1789427759.089853:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789427759.089858:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939989632:12345-0@lo:503: 00000100:00100000:1.0:1789427759.089927:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939989632:12345-0@lo:503: Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.089934:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789427759.089968:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939989632:0@lo:503: 00000100:00100000:1.0:1789427759.090158:0:9921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9921:1876350939989760:0@lo:502: 00000100:00100000:1.0:1789427759.090273:0:9921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.090324:0:9921:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.096279:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989760 00000100:00100000:3.0:1789427759.096302:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989760 00000100:00100000:3.0:1789427759.096364:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789427759.096375:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9921:x1876350939989760:12345-0@lo:502: 00000100:00100000:3.0:1789427759.096586:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9921:x1876350939989760:12345-0@lo:502: Request processed in 213us (6312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.096594:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789427759.096752:0:9921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9921:1876350939989760:0@lo:502: 00000100:00100000:2.0:1789427759.096829:0:9921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9921:1876350939989888:0@lo:502: 00000100:00100000:2.0:1789427759.096874:0:9921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.096911:0:9921:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.099269:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939989888 00000100:00100000:3.0:1789427759.099280:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939989888 00000100:00100000:3.0:1789427759.099337:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789427759.099347:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9921:x1876350939989888:12345-0@lo:502: 00000100:00100000:3.0:1789427759.099475:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:9921:x1876350939989888:12345-0@lo:502: Request processed in 129us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.099482:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789427759.099577:0:9921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9921:1876350939989888:0@lo:502: 00000040:00080000:2.0:1789427759.099602:0:9921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789427759.100016:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789427759.100038:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789427759.100049:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.100061:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427759.100071:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789427759.100075:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789427759.100078:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789427759.100108:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.100116:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.100126:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.100141:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990016:0@lo:101: 00000100:00100000:3.0:1789427759.100183:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.100217:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.100309:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990016 00000100:00100000:2.0:1789427759.100314:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990016 00000100:00100000:2.0:1789427759.100344:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789427759.100351:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350939990016:12345-0@lo:101: 00010000:00010000:2.0:1789427759.100360:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.100375:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518228 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.100399:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518228 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.100410:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518228 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.100449:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9400, rc 0) 00000100:00100000:2.0:1789427759.100476:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990016:12345-0@lo:101: Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.100483:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789427759.100585:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990016:0@lo:101: 00010000:00010000:3.0:1789427759.100596:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.100606:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.100660:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990144:0@lo:501: 00000100:00100000:3.0:1789427759.100680:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.100700:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.100711:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990144 00000100:00100000:3.0:1789427759.100714:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990144 00000100:00100000:3.0:1789427759.100732:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789427759.100737:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990144:12345-0@lo:501: 00000100:00100000:3.0:1789427759.100841:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990144:12345-0@lo:501: Request processed in 102us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.100848:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789427759.100873:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990144:0@lo:501: 00000100:00100000:3.0:1789427759.100895:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990272:0@lo:503: 00000100:00100000:3.0:1789427759.100925:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.100937:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.100946:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990272 00000100:00100000:3.0:1789427759.100950:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990272 00000100:00100000:3.0:1789427759.100964:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789427759.100969:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990272:12345-0@lo:503: 00000100:00100000:3.0:1789427759.101029:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990272:12345-0@lo:503: Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.101036:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789427759.101066:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990272:0@lo:503: 00000100:00100000:2.0:1789427759.101539:0:9923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9923:1876350939990400:0@lo:502: 00000100:00100000:2.0:1789427759.101568:0:9923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.101587:0:9923:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.101621:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990400 00000100:00100000:3.0:1789427759.101625:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990400 00000100:00100000:3.0:1789427759.101655:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789427759.101661:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9923:x1876350939990400:12345-0@lo:502: 00000100:00100000:3.0:1789427759.101717:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9923:x1876350939990400:12345-0@lo:502: Request processed in 56us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.101723:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427759.101783:0:9923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9923:1876350939990400:0@lo:502: 00000020:01000000:2.0:1789427759.101804:0:9923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427759.101813:0:9923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427759.101815:0:9923:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789427759.101821:0:9923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789427759.101823:0:9923:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789427759.101835:0:9923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9923:1876350939990528:0@lo:502: 00000100:00100000:2.0:1789427759.101863:0:9923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.101882:0:9923:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.101917:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990528 00000100:00100000:3.0:1789427759.101921:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990528 00000100:00100000:3.0:1789427759.101945:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789427759.101951:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9923:x1876350939990528:12345-0@lo:502: 00000100:00100000:3.0:1789427759.102001:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:9923:x1876350939990528:12345-0@lo:502: Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.102007:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789427759.102064:0:9923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9923:1876350939990528:0@lo:502: 00000020:01000000:2.0:1789427759.102079:0:9923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427759.102083:0:9923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427759.102085:0:9923:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789427759.102088:0:9923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789427759.102223:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789427759.102247:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789427759.102253:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.102262:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427759.102270:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789427759.102273:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196adadd000 from 39 10000000:01000000:3.0:1789427759.102275:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789427759.102289:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.102350:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.102370:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.102382:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990656:0@lo:101: 00000100:00100000:3.0:1789427759.102404:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.102473:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.107532:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990656 00000100:00100000:2.0:1789427759.107544:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990656 00000100:00100000:2.0:1789427759.107601:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789427759.107611:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350939990656:12345-0@lo:101: 00010000:00010000:2.0:1789427759.107628:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.107653:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518236 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.107683:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518236 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.107695:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518236 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.107706:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9000, rc 0) 00000100:00100000:2.0:1789427759.107785:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939990656:12345-0@lo:101: Request processed in 175us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.107792:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789427759.111916:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990656:0@lo:101: 00010000:00010000:3.0:1789427759.111948:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.111962:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.112053:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990784:0@lo:501: 00000100:00100000:3.0:1789427759.112112:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.112204:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.115370:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990784 00000100:00100000:2.0:1789427759.115383:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990784 00000100:00100000:2.0:1789427759.115558:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789427759.115570:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939990784:12345-0@lo:501: 00000100:00100000:2.0:1789427759.115758:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939990784:12345-0@lo:501: Request processed in 191us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.115766:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427759.116331:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990784:0@lo:501: 00000100:00100000:0.0:1789427759.116487:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990912:0@lo:503: 00000100:00100000:0.0:1789427759.116534:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.116749:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.117253:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939990912 00000100:00100000:2.0:1789427759.117259:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939990912 00000100:00100000:2.0:1789427759.117281:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789427759.117288:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939990912:12345-0@lo:503: 00000100:00100000:2.0:1789427759.117448:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939990912:12345-0@lo:503: Request processed in 159us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.117455:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789427759.117505:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939990912:0@lo:503: 00000100:00100000:3.0:1789427759.119155:0:9925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9925:1876350939991040:0@lo:502: 00000100:00100000:3.0:1789427759.119199:0:9925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.119230:0:9925:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a82000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.119250:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991040 00000100:00100000:2.0:1789427759.119258:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991040 00000100:00100000:3.0:1789427759.119311:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789427759.119329:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:9925:x1876350939991040:12345-0@lo:502: 00000100:00100000:2.0:1789427759.119905:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:9925:x1876350939991040:12345-0@lo:502: Request processed in 578us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.119914:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789427759.119934:0:9925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9925:1876350939991040:0@lo:502: 00000100:00100000:3.0:1789427759.119979:0:9925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9925:1876350939991168:0@lo:502: 00000100:00100000:3.0:1789427759.120098:0:9925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.120120:0:9925:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.120131:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991168 00000100:00100000:0.0:1789427759.120136:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991168 00000100:00100000:0.0:1789427759.120195:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789427759.120203:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:9925:x1876350939991168:12345-0@lo:502: 00000100:00100000:0.0:1789427759.120307:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:9925:x1876350939991168:12345-0@lo:502: Request processed in 105us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.120313:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789427759.120370:0:9925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9925:1876350939991168:0@lo:502: 00000040:00080000:3.0:1789427759.120387:0:9925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789427759.120576:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789427759.120597:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427759.120607:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.120626:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427759.120637:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427759.120641:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196adadd000 from 6 10000000:01000000:1.0:1789427759.120644:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427759.120670:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.120678:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.120688:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.120699:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991296:0@lo:101: 00000100:00100000:1.0:1789427759.120726:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.120830:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.120889:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991296 00000100:00100000:2.0:1789427759.120893:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991296 00000100:00100000:2.0:1789427759.120911:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427759.120916:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350939991296:12345-0@lo:101: 00010000:00010000:2.0:1789427759.120925:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.120938:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e8e00/0x84fc867ede51824b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518244 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.120960:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e8e00/0x84fc867ede51824b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518244 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.120971:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e8e00/0x84fc867ede51824b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518244 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.120981:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8e00, rc 0) 00000100:00100000:2.0:1789427759.121015:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939991296:12345-0@lo:101: Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.121021:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789427759.121080:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991296:0@lo:101: 00010000:00010000:1.0:1789427759.121091:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.121101:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.121140:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991424:0@lo:256: 00000100:00100000:1.0:1789427759.121168:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.121195:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.121228:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991424 00000100:00100000:0.0:1789427759.121232:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991424 00000100:00100000:0.0:1789427759.121263:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789427759.121268:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939991424:12345-0@lo:256: 20000000:01000000:0.0:1789427759.121286:0:6475:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789427759.121311:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789427759.121315:0:6475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789427759.121390:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939991424:12345-0@lo:256: Request processed in 121us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.121396:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789427759.121516:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991424:0@lo:256: 10000000:01000000:1.0:1789427759.121555:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427759.121560:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.121568:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427759.121575:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789427759.121577:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789427759.121579:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789427759.121592:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.121600:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.121607:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.121617:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991552:0@lo:101: 00000100:00100000:1.0:1789427759.121638:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.121661:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.121710:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991552 00000100:00100000:2.0:1789427759.121714:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991552 00000100:00100000:2.0:1789427759.121729:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427759.121734:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350939991552:12345-0@lo:101: 00010000:00010000:2.0:1789427759.121741:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.121759:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518252 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.121774:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518252 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.121788:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518252 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.121795:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427759.121829:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939991552:12345-0@lo:101: Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.121835:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789427759.121892:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991552:0@lo:101: 00010000:00010000:1.0:1789427759.121902:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.121910:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.121958:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991680:0@lo:501: 00000100:00100000:1.0:1789427759.121980:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.121998:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.122037:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991680 00000100:00100000:2.0:1789427759.122041:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991680 00000100:00100000:2.0:1789427759.122056:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789427759.122061:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939991680:12345-0@lo:501: 00000100:00100000:2.0:1789427759.122164:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939991680:12345-0@lo:501: Request processed in 102us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.122170:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789427759.122231:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991680:0@lo:501: 00000100:00100000:1.0:1789427759.122267:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991808:0@lo:503: 00000100:00100000:1.0:1789427759.122307:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.122323:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.122403:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991808 00000100:00100000:2.0:1789427759.122408:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991808 00000100:00100000:2.0:1789427759.122440:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789427759.122446:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939991808:12345-0@lo:503: 00000100:00100000:2.0:1789427759.122519:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939991808:12345-0@lo:503: Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.122526:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789427759.122672:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939991808:0@lo:503: 00000100:00100000:1.0:1789427759.122953:0:9926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9926:1876350939991936:0@lo:502: 00000100:00100000:1.0:1789427759.122983:0:9926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.123008:0:9926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.123047:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939991936 00000100:00100000:2.0:1789427759.123050:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939991936 00000100:00100000:2.0:1789427759.123075:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789427759.123081:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:9926:x1876350939991936:12345-0@lo:502: 00000100:00100000:2.0:1789427759.123152:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:9926:x1876350939991936:12345-0@lo:502: Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.123164:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789427759.123263:0:9926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9926:1876350939991936:0@lo:502: 00000020:01000000:1.0:1789427759.123282:0:9926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789427759.123288:0:9926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789427759.123351:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427759.123354:0:9926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789427759.123360:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789427759.123364:0:9926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:1.0:1789427759.123388:0:9926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789427759.123391:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427759.123406:0:9926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91958302cd40) 00000020:00000080:1.0:1789427759.123452:0:9926:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1789427759.123459:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789427759.123552:0:9926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789427759.123559:0:9926:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789427759.123569:0:9926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede518267 00010000:00080000:1.0:1789427759.123598:0:9926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919583030800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789427759.124279:0:9926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1789427759.124445:0:9926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789427759.124457:0:9926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789427759.124629:0:9926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427759.124732:0:9926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427759.124886:0:9926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789427759.125003:0:9926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789427759.125845:0:9927:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427759.125850:0:9927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789427759.127373:0:9926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789427759.127386:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789427759.127447:0:9926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789427759.127471:0:9926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede51826e 00000100:00080000:2.0:1789427759.127481:0:9926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427759.127491:0:9926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff919583030800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427759.127524:0:9926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196ad929180 x1876350939992064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789427759.127582:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939992064:0@lo:8: 00000100:00100000:1.0:1789427759.127644:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789427759.127736:0:9926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789427759.127799:0:9926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427759.127803:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427759.127806:0:9926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789427759.127809:0:9926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427759.127812:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427759.127813:0:9926:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789427759.127816:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789427759.127818:0:9926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789427759.127840:0:9926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9926:1876350939992192:0@lo:502: 00000100:00100000:2.0:1789427759.127879:0:9926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.127901:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992192 00000100:00100000:2.0:1789427759.127907:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992192 00000100:00100000:2.0:1789427759.127937:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789427759.127945:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:9926:x1876350939992192:12345-0@lo:502: 00000100:00100000:2.0:1789427759.128035:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:9926:x1876350939992192:12345-0@lo:502: Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.128042:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789427759.128073:0:9926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.128094:0:9926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9926:1876350939992192:0@lo:502: 00000020:01000000:2.0:1789427759.128113:0:9926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427759.128116:0:9926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427759.128117:0:9926:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789427759.128121:0:9926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1789427759.128168:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789427759.128189:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789427759.128200:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.128212:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427759.128223:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789427759.128226:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919684ed8800 from 39 10000000:01000000:2.0:1789427759.128230:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427759.128265:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.128273:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.128284:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427759.128460:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939992448:0@lo:400: 00000100:00100000:0.0:1789427759.128492:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128511:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350939992960:0@lo:400: 00000100:00100000:0.0:1789427759.128528:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128542:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350939993472:0@lo:400: 00000100:00100000:0.0:1789427759.128559:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128574:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789427759.128578:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939992576:0@lo:400: 00000100:00100000:0.0:1789427759.128599:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128612:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939993088:0@lo:400: 00000100:00100000:0.0:1789427759.128630:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128654:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939992704:0@lo:400: 00000100:00100000:0.0:1789427759.128675:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128691:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939993216:0@lo:400: 00000100:00100000:0.0:1789427759.128707:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128722:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789427759.128726:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350939992832:0@lo:400: 00000100:00100000:0.0:1789427759.128743:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128752:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350939993344:0@lo:400: 00000100:00100000:0.0:1789427759.128783:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.128805:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992448 00000100:00100000:0.0:1789427759.128809:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992448 00000100:00100000:0.0:1789427759.128830:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992960 00000100:00100000:0.0:1789427759.128833:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992960 00000100:00100000:0.0:1789427759.128852:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993472 00000100:00100000:0.0:1789427759.128854:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993472 00000100:00100000:0.0:1789427759.128864:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992704 00000100:00100000:0.0:1789427759.128866:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992704 00000100:00100000:0.0:1789427759.128875:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992832 00000100:00100000:0.0:1789427759.128877:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992832 00000100:00100000:0.0:1789427759.128887:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993344 00000100:00100000:0.0:1789427759.128889:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993344 00000100:00100000:0.0:1789427759.128902:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427759.128907:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939992448:12345-0@lo:400: 00000100:00100000:0.0:1789427759.128942:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939992448:12345-0@lo:400: Request processed in 35us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.128948:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427759.128960:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427759.128965:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350939992960:12345-0@lo:400: 00000100:00100000:0.0:1789427759.128987:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350939992960:12345-0@lo:400: Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.128992:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427759.129001:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427759.129005:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350939993472:12345-0@lo:400: 00000100:00100000:0.0:1789427759.129024:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350939993472:12345-0@lo:400: Request processed in 19us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.129030:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427759.129038:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427759.129049:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939992704:12345-0@lo:400: 00000100:00100000:0.0:1789427759.129075:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350939992704:12345-0@lo:400: Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.129081:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427759.129091:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427759.129096:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350939992832:12345-0@lo:400: 00000100:00100000:0.0:1789427759.129118:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350939992832:12345-0@lo:400: Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.129124:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427759.129132:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427759.129137:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350939993344:12345-0@lo:400: 00000100:00100000:0.0:1789427759.129157:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350939993344:12345-0@lo:400: Request processed in 20us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.129162:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427759.129186:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992576 00000100:00100000:0.0:1789427759.129190:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992576 00000100:00100000:0.0:1789427759.129213:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427759.129219:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939992576:12345-0@lo:400: 00000100:00100000:0.0:1789427759.129271:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939992576:12345-0@lo:400: Request processed in 52us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.129277:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789427759.129372:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939992320:0@lo:101: 00000100:00100000:2.0:1789427759.129398:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.129429:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.129444:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992320 00000100:00100000:2.0:1789427759.129447:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992320 00000100:00100000:2.0:1789427759.129472:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427759.129477:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350939992320:12345-0@lo:101: 00010000:00010000:2.0:1789427759.129486:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.129500:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518275 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.129521:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518275 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.129533:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518275 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.129543:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428600, rc 0) 00000100:00100000:2.0:1789427759.129566:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939992320:12345-0@lo:101: Request processed in 89us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.129572:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427759.129600:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939992320:0@lo:101: 00010000:00010000:2.0:1789427759.129612:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.129622:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427759.129667:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939993600:0@lo:501: 00000100:00100000:2.0:1789427759.129687:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.129697:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.129706:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993600 00000100:00100000:2.0:1789427759.129709:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993600 00000100:00100000:2.0:1789427759.129727:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789427759.129737:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939993600:12345-0@lo:501: 00000100:00100000:2.0:1789427759.129838:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939993600:12345-0@lo:501: Request processed in 100us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.129844:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789427759.129867:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939993600:0@lo:501: 00000100:00100000:2.0:1789427759.129888:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939993728:0@lo:503: 00000100:00100000:2.0:1789427759.129917:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.129928:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.129937:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993728 00000100:00100000:2.0:1789427759.129940:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993728 00000100:00100000:2.0:1789427759.129953:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789427759.129957:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939993728:12345-0@lo:503: 00000100:00100000:2.0:1789427759.130019:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939993728:12345-0@lo:503: Request processed in 61us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.130026:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789427759.130056:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939993728:0@lo:503: 00000100:00100000:0.0:1789427759.130271:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939992064 00000100:00100000:0.0:1789427759.130276:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939992064 00000100:00100000:3.0:1789427759.130568:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993088 00000100:00100000:3.0:1789427759.130573:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993088 00000100:00100000:3.0:1789427759.130609:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993216 00000100:00100000:3.0:1789427759.130612:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993216 00000100:00100000:3.0:1789427759.130629:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427759.130636:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939993088:12345-0@lo:400: 00000100:00100000:3.0:1789427759.130675:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939993088:12345-0@lo:400: Request processed in 39us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.130681:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427759.130692:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789427759.130698:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939993216:12345-0@lo:400: 00000100:00100000:3.0:1789427759.130720:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350939993216:12345-0@lo:400: Request processed in 23us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.130725:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789427759.130734:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789427759.130738:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350939992064:12345-0@lo:8: 00010000:00080000:3.0:1789427759.130763:0:8402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:3.0:1789427759.130791:0:8402:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede518283 00002000:00100000:3.0:1789427759.130807:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9196bca80800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789427759.130812:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789427759.130816:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789427759.130881:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789427759.131120:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789427759.131146:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9196bca82000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427759.131188:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350939992064:12345-0@lo:8: Request processed in 448us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.131195:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789427759.131373:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad929180 x1876350939992064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427759.131385:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789427759.131393:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789427759.131401:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789427759.131407:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789427759.131410:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583030800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789427759.131446:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789427759.131451:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350939992064:0@lo:8: 00000100:00100000:3.0:1789427759.131703:0:9929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9929:1876350939993856:0@lo:502: 00000100:00100000:3.0:1789427759.131742:0:9929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.131773:0:9929:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.131812:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993856 00000100:00100000:2.0:1789427759.131817:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993856 00000100:00100000:2.0:1789427759.131847:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789427759.131853:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:9929:x1876350939993856:12345-0@lo:502: 00000100:00100000:2.0:1789427759.131943:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:9929:x1876350939993856:12345-0@lo:502: Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.131950:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789427759.132017:0:9929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9929:1876350939993856:0@lo:502: 00000100:00100000:3.0:1789427759.132054:0:9929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9929:1876350939993984:0@lo:502: 00000100:00100000:3.0:1789427759.132082:0:9929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.132127:0:9929:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085f00 going to sleep for 11 seconds 00000100:00080000:0.0:1789427759.132221:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427759.132227:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427759.132231:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789427759.132268:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bd880 x1876350939992832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132286:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350939992832:0@lo:400: 00010000:00080000:0.0:1789427759.132312:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bdc00 x1876350939993344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132320:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350939993344:0@lo:400: 00010000:00080000:0.0:1789427759.132333:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bf480 x1876350939992704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132341:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350939992704:0@lo:400: 00010000:00080000:0.0:1789427759.132351:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bdf80 x1876350939993216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132359:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789427759.132368:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350939993216:0@lo:400: 00000100:00100000:0.0:1789427759.132401:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939992576:0@lo:400: 00010000:00080000:0.0:1789427759.132431:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bc700 x1876350939993088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132441:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939993088:0@lo:400: 00010000:00080000:0.0:1789427759.132454:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bf100 x1876350939992448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132462:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939992448:0@lo:400: 00010000:00080000:0.0:1789427759.132472:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bd500 x1876350939992960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132480:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350939992960:0@lo:400: 00010000:00080000:0.0:1789427759.132498:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831be300 x1876350939993472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.132506:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350939993472:0@lo:400: 00000100:00100000:2.0:1789427759.132634:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939993984 00000100:00100000:2.0:1789427759.132639:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939993984 00000100:00100000:2.0:1789427759.132689:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789427759.132701:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:9929:x1876350939993984:12345-0@lo:502: 00000100:00100000:2.0:1789427759.132769:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:9929:x1876350939993984:12345-0@lo:502: Request processed in 68us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.132776:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789427759.132828:0:9929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9929:1876350939993984:0@lo:502: 00000040:00080000:0.0:1789427759.132846:0:9929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000004:00080000:1.0:1789427759.133003:0:9927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789427759.133068:0:9927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 103627652506ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789427759.133074:0:9927:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:3.0:1789427759.134490:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789427759.134523:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789427759.134534:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134548:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427759.134568:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789427759.134572:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919684ed8800 from 6 10000000:01000000:3.0:1789427759.134576:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789427759.134610:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134619:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134630:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427759.134649:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994112:0@lo:101: 00000100:00100000:3.0:1789427759.134697:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.134743:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.134762:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994112 00000100:00100000:3.0:1789427759.134768:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994112 00000100:00100000:3.0:1789427759.134797:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789427759.134804:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350939994112:12345-0@lo:101: 00010000:00010000:3.0:1789427759.134814:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427759.134827:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919680030600/0x84fc867ede518291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51828a expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134852:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919680030600/0x84fc867ede518291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51828a expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134862:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919680030600/0x84fc867ede518291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51828a expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.134882:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680030600, rc 0) 00000100:00100000:3.0:1789427759.134921:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350939994112:12345-0@lo:101: Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.134927:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427759.134987:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994112:0@lo:101: 00010000:00010000:0.0:1789427759.135013:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.135027:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427759.135095:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994240:0@lo:256: 00000100:00100000:0.0:1789427759.135149:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.135179:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.135215:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994240 00000100:00100000:3.0:1789427759.135221:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994240 00000100:00100000:3.0:1789427759.135252:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789427759.135258:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350939994240:12345-0@lo:256: 20000000:01000000:3.0:1789427759.135272:0:6477:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789427759.135291:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789427759.135294:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789427759.135472:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350939994240:12345-0@lo:256: Request processed in 213us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.135480:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789427759.135583:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994240:0@lo:256: 10000000:01000000:0.0:1789427759.135639:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427759.135647:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.135657:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427759.135723:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789427759.135726:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789427759.135729:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427759.135808:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.135818:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.135827:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427759.135838:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994368:0@lo:101: 00000100:00100000:0.0:1789427759.135880:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.135909:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.136311:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994368 00000100:00100000:2.0:1789427759.136317:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994368 00000100:00100000:2.0:1789427759.136350:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789427759.136357:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350939994368:12345-0@lo:101: 00010000:00010000:2.0:1789427759.136365:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427759.136377:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518298 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.136397:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518298 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.136405:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518298 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.136433:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427759.136477:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939994368:12345-0@lo:101: Request processed in 120us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.136487:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789427759.136489:0:9928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939994496:0@lo:700: 00000100:00100000:2.0:1789427759.136534:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994368:0@lo:101: 00000100:00100000:0.0:1789427759.136541:0:9928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427759.136558:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427759.136568:0:9928:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4c300 going to sleep for 11 seconds 00010000:00010000:2.0:1789427759.136571:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427759.136646:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994624:0@lo:501: 00000100:00100000:2.0:1789427759.136674:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.136702:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.136794:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994624 00000100:00100000:0.0:1789427759.136802:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994624 00000100:00100000:0.0:1789427759.136857:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789427759.136867:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939994624:12345-0@lo:501: 00000100:00100000:0.0:1789427759.136989:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939994624:12345-0@lo:501: Request processed in 123us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.136996:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789427759.137318:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994624:0@lo:501: 00000100:00100000:2.0:1789427759.137346:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994752:0@lo:503: 00000100:00100000:2.0:1789427759.137388:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.137407:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427759.137443:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994752 00000100:00100000:2.0:1789427759.137448:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994752 00000100:00100000:2.0:1789427759.137479:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789427759.137485:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939994752:12345-0@lo:503: 00000100:00100000:2.0:1789427759.137579:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939994752:12345-0@lo:503: Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.137587:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789427759.137620:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939994752:0@lo:503: 00000100:00100000:3.0:1789427759.138169:0:8905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994496 00000100:00100000:3.0:1789427759.138175:0:8905:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994496 00000100:00080000:2.0:1789427759.138229:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427759.138233:0:8905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427759.138254:0:8905:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9928:x1876350939994496:12345-0@lo:700: 00000100:00100000:3.0:1789427759.138288:0:8905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8905:1876350939994880:0@lo:700: 00000100:00100000:3.0:1789427759.138374:0:8905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.138376:0:9930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9930:1876350939995008:0@lo:502: 00000100:00100000:3.0:1789427759.138405:0:8905:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.138563:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939994880 00000100:00100000:0.0:1789427759.138569:0:6489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939994880 00000100:00100000:0.0:1789427759.138605:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427759.138613:0:6489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8905:x1876350939994880:12345-0@lo:700: 00000100:00100000:1.0:1789427759.138776:0:9930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.138805:0:9930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.138851:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995008 00000100:00100000:0.0:1789427759.138861:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995008 00000100:00100000:0.0:1789427759.138925:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789427759.138940:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:9930:x1876350939995008:12345-0@lo:502: 00000100:00100000:0.0:1789427759.139021:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:9930:x1876350939995008:12345-0@lo:502: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.139028:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789427759.139088:0:9930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9930:1876350939995008:0@lo:502: 00000020:01000000:1.0:1789427759.139112:0:9930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789427759.139120:0:9930:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789427759.139128:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427759.139130:0:9930:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789427759.139135:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789427759.139139:0:9930:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:1.0:1789427759.139174:0:9930:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789427759.139179:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427759.139195:0:9930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9195830299c0) 00000020:00000080:1.0:1789427759.139247:0:9930:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789427759.139255:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789427759.139345:0:9930:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789427759.139351:0:9930:0:(osd_handler.c:8926:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789427759.139358:0:9930:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede5182ad 00010000:00080000:1.0:1789427759.139389:0:9930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9195837e5800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.124@tcp at head 00000004:00080000:3.0:1789427759.139620:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:1.0:1789427759.139701:0:9930:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789427759.139807:0:9930:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789427759.139819:0:9930:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789427759.139992:0:9930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427759.140091:0:9930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427759.140250:0:9930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789427759.140359:0:9930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789427759.140977:0:9931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427759.140983:0:9931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789427759.141624:0:9930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789427759.141632:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789427759.141666:0:9930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789427759.141686:0:9930:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede5182b4 00000100:00080000:1.0:1789427759.141694:0:9930:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789427759.141703:0:9930:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9195837e5800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427759.141732:0:9930:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361c000 x1876350939995136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427759.141755:0:9930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789427759.141800:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939995136:0@lo:8: 00000020:01000000:1.0:1789427759.141813:0:9930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427759.141820:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427759.141823:0:9930:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789427759.141826:0:9930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427759.141832:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427759.141834:0:9930:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427759.141839:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427759.141848:0:9930:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789427759.141867:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.141877:0:9930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9930:1876350939995264:0@lo:502: 00000100:00100000:1.0:1789427759.141941:0:9930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.141965:0:9930:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.141993:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995264 00000100:00100000:3.0:1789427759.142002:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995264 00000100:00100000:3.0:1789427759.142043:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789427759.142051:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:9930:x1876350939995264:12345-0@lo:502: 00000100:00100000:2.0:1789427759.142105:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995136 00000100:00100000:2.0:1789427759.142112:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995136 00000100:00100000:2.0:1789427759.142161:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427759.142170:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3612:x1876350939995136:12345-0@lo:8: 00000100:00100000:3.0:1789427759.142182:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:9930:x1876350939995264:12345-0@lo:502: Request processed in 129us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.142191:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00080000:2.0:1789427759.142199:0:8401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:2.0:1789427759.142243:0:8401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede5182bb 00002000:00100000:2.0:1789427759.142259:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9195837ae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789427759.142264:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789427759.142267:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789427759.142325:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789427759.142348:0:8401:0:(import.c:65:import_set_state_nolock()) ffff9195837ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427759.142402:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350939995136:12345-0@lo:8: Request processed in 233us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427759.142410:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789427759.142470:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361c000 x1876350939995136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427759.142482:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789427759.142490:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789427759.142497:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789427759.142503:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789427759.142506:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195837e5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789427759.142523:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789427759.142531:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350939995136:0@lo:8: 00000100:00100000:1.0:1789427759.142580:0:9930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:9930:1876350939995264:0@lo:502: 00000020:01000000:1.0:1789427759.142605:0:9930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427759.142609:0:9930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427759.142610:0:9930:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789427759.142614:0:9930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:1.0:1789427759.142722:0:9931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789427759.142761:0:9931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 103637345723ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789427759.142768:0:9931:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1789427759.144513:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789427759.144542:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789427759.144553:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.144566:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427759.144577:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789427759.144580:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688454d40 from 1 10000000:01000000:1.0:1789427759.144584:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789427759.144617:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.144625:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427759.144636:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427759.144662:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939995392:0@lo:101: 00000100:00100000:1.0:1789427759.144703:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.144727:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.144819:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995392 00000100:00100000:0.0:1789427759.144826:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995392 00000100:00100000:0.0:1789427759.145282:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789427759.145295:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350939995392:12345-0@lo:101: 00010000:00010000:0.0:1789427759.145309:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427759.145324:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5182c2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.145349:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.145361:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427759.145371:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208600, rc 0) 00000100:00100000:0.0:1789427759.145443:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350939995392:12345-0@lo:101: Request processed in 151us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.145451:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789427759.145540:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939995392:0@lo:101: 00010000:00010000:2.0:1789427759.145561:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427759.145572:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427759.145627:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939995520:0@lo:501: 00000100:00100000:2.0:1789427759.145652:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427759.145795:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427759.145837:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995520 00000100:00100000:1.0:1789427759.145842:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995520 00000100:00100000:1.0:1789427759.145870:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789427759.145877:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350939995520:12345-0@lo:501: 00000100:00100000:1.0:1789427759.145964:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350939995520:12345-0@lo:501: Request processed in 88us (311us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427759.145972:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789427759.146052:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350939995520:0@lo:501: 10000000:01000000:3.0:1789427759.146112:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789427759.146121:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427759.146132:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427759.146530:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789427759.146640:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789427759.150017:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939995648:0@lo:13: 00000100:00100000:0.0:1789427759.150078:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789427759.150139:0:9932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789427759.150159:0:9932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939995776:0@lo:7: 00000100:00100000:3.0:1789427759.150187:0:9932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.150218:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995776 00000100:00100000:3.0:1789427759.150226:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995776 00000100:00100000:3.0:1789427759.150356:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427759.150360:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995648 00000100:00100000:3.0:1789427759.150369:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9932:x1876350939995776:12345-0@lo:7: 00000100:00100000:1.0:1789427759.150371:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995648 00000100:00100000:1.0:1789427759.150452:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427759.150463:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350939995648:12345-0@lo:13: 00002000:00000024:1.0:1789427759.150493:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789427759.150571:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350939995648:12345-0@lo:13: Request processed in 108us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.150579:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789427759.151286:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789427759.151318:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919581dbf480 x1876350939995648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.151352:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350939995648:0@lo:13: 00000100:00100000:0.0:1789427759.151461:0:9932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00002000:00080000:3.0:1789427759.153571:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789427759.153576:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789427759.153695:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9932:x1876350939995776:12345-0@lo:7: Request processed in 3328us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.153703:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789427759.153764:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919581dbf100 x1876350939995776/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.153776:0:9932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939995776:0@lo:7: 00000004:00080000:0.0:1789427759.153786:0:9932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789427759.153811:0:9932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939995904:0@lo:5: 00000100:00100000:0.0:1789427759.153837:0:9932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.153905:0:9932:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.153939:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939995904 00000100:00100000:3.0:1789427759.153944:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939995904 00000100:00100000:3.0:1789427759.154025:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427759.154033:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9932:x1876350939995904:12345-0@lo:5: 00002000:00080000:3.0:1789427759.154053:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789427759.154057:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789427759.156513:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789427759.156524:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789427759.156528:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789427759.156725:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9932:x1876350939995904:12345-0@lo:5: Request processed in 2690us (2884us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789427759.156734:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427759.156797:0:6489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8905:x1876350939994880:12345-0@lo:700: Request processed in 18182us (18422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.156807:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789427759.156850:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919581dbd500 x1876350939994880/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427759.156869:0:8905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8905:1876350939994880:0@lo:700: 40000000:02000000:2.0:1789427759.156888:0:8905:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00010000:00080000:0.0:1789427759.156927:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831be300 x1876350939995904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.156937:0:9932:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789427759.156943:0:9932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939995904:0@lo:5: 00000004:00080000:0.0:1789427759.156953:0:9932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789427759.156983:0:9932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939996032:0@lo:700: 00000100:00100000:0.0:1789427759.157008:0:9932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427759.157068:0:9932:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427759.157098:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996032 00000100:00100000:1.0:1789427759.157102:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996032 00000100:00100000:1.0:1789427759.157138:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427759.157146:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9932:x1876350939996032:12345-0@lo:700: 00000100:00100000:3.0:1789427759.176115:0:8905:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939994496:12345-0@lo:700: Request processed in 37855us (39570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.176130:0:8905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789427759.176213:0:9928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca2a300 x1876350939994496/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.176248:0:9928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939994496:0@lo:700: 00000004:00080000:1.0:1789427759.182583:0:9928:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789427759.182613:0:9928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996288:0@lo:7: 00000100:00100000:1.0:1789427759.182668:0:9928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.182703:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996288 00000100:00100000:1.0:1789427759.182709:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996288 00000100:00100000:1.0:1789427759.182745:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427759.182753:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939996288:12345-0@lo:7: 00002000:00080000:1.0:1789427759.186106:0:8902:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789427759.186112:0:8902:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789427759.186160:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939996288:12345-0@lo:7: Request processed in 3406us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.186167:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427759.186211:0:9928:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427759.187371:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939996160:0@lo:13: 00000100:00100000:3.0:1789427759.187407:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427759.187471:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996160 00000100:00100000:3.0:1789427759.187477:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996160 00000100:00100000:3.0:1789427759.187507:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789427759.187522:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939996160:12345-0@lo:13: 00002000:00000024:3.0:1789427759.187538:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789427759.187571:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939996160:12345-0@lo:13: Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427759.187578:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789427759.187609:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f100 x1876350939996160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427759.187626:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939996160:0@lo:13: 00010000:00080000:1.0:1789427759.190328:0:9928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f800 x1876350939996288/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.190346:0:9928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996288:0@lo:7: 00000004:00080000:1.0:1789427759.190357:0:9928:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789427759.190396:0:9928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996416:0@lo:5: 00000100:00100000:1.0:1789427759.190455:0:9928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.190481:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996416 00000100:00100000:1.0:1789427759.190485:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996416 00000100:00100000:1.0:1789427759.190516:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427759.190523:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939996416:12345-0@lo:5: 00002000:00080000:1.0:1789427759.190542:0:8400:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789427759.190578:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939996416:12345-0@lo:5: Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.190585:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427759.190604:0:9928:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00010000:00080000:1.0:1789427759.190617:0:9928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f800 x1876350939996416/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.190627:0:9928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996416:0@lo:5: 00000004:00080000:1.0:1789427759.190635:0:9928:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789427759.190654:0:9928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996544:0@lo:5: 00000100:00100000:1.0:1789427759.190673:0:9928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.190691:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996544 00000100:00100000:1.0:1789427759.190695:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996544 00000100:00100000:1.0:1789427759.190716:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427759.190722:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9928:x1876350939996544:12345-0@lo:5: 00002000:00080000:1.0:1789427759.190740:0:8902:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1789427759.195189:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9928:x1876350939996544:12345-0@lo:5: Request processed in 4463us (4511us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789427759.195201:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427759.195231:0:9928:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00010000:00080000:1.0:1789427759.196336:0:9928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f800 x1876350939996544/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.196352:0:9928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9928:1876350939996544:0@lo:5: 00000004:00080000:1.0:1789427759.196364:0:9928:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789427759.196397:0:9928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9928:1876350939996672:0@lo:900: 00000100:00100000:1.0:1789427759.196450:0:9928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.196478:0:9928:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.198410:0:8903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996672 00000100:00100000:0.0:1789427759.198443:0:8903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996672 00000100:00100000:0.0:1789427759.198486:0:8903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789427759.198495:0:8903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:9928:x1876350939996672:12345-0@lo:900: 00000100:00100000:0.0:1789427759.198548:0:8903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:9928:x1876350939996672:12345-0@lo:900: Request processed in 54us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427759.198555:0:8903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789427759.199410:0:9928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361ea00 x1876350939996672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.199437:0:9928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9928:1876350939996672:0@lo:900: 00000001:00080000:0.0:1789427759.200816:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789427759.201380:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9932:x1876350939996032:12345-0@lo:700: Request processed in 44233us (44368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427759.201388:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789427759.201548:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831be300 x1876350939996032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427759.201559:0:9932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939996032:0@lo:700: 00000004:02000040:1.0:1789427759.203616:0:9932:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789427759.210167:0:9932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939996800:0@lo:5: 00000100:00100000:1.0:1789427759.210228:0:9932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427759.211799:0:9932:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427759.212005:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996800 00000100:00100000:0.0:1789427759.212014:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996800 00000100:00100000:0.0:1789427759.212092:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427759.212101:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9932:x1876350939996800:12345-0@lo:5: 00002000:00080000:3.0:1789427759.217944:0:8400:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789427759.217962:0:8400:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789427759.221114:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9932:x1876350939996800:12345-0@lo:5: Request processed in 9009us (10880us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789427759.221126:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789427759.221196:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361ea00 x1876350939996800/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427759.221214:0:9932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1876350939996800:0@lo:5: 00000004:00080000:1.0:1789427759.221228:0:9932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:0.0:1789427759.281046:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1789427759.536683:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427760.434898:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939996928:0@lo:13: 00000100:00100000:3.0:1789427760.434963:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427760.435024:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939997056:0@lo:13: 00000100:00100000:3.0:1789427760.435049:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427760.435079:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939996928 00000100:00100000:3.0:1789427760.435086:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939996928 00000100:00100000:3.0:1789427760.435116:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997056 00000100:00100000:3.0:1789427760.435120:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997056 00000100:00100000:3.0:1789427760.435134:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789427760.435142:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939996928:12345-0@lo:13: 00002000:00000024:3.0:1789427760.435167:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427760.435207:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939996928:12345-0@lo:13: Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427760.435214:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789427760.435246:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427760.435253:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939997056:12345-0@lo:13: 00002000:00000024:3.0:1789427760.435262:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427760.435288:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939997056:12345-0@lo:13: Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427760.435293:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789427760.435323:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831be300 x1876350939996928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427760.435340:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939996928:0@lo:13: 00010000:00080000:3.0:1789427760.435361:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919581dbf800 x1876350939997056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427760.435371:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939997056:0@lo:13: 00010000:00010000:0.0:1789427760.561009:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789427760.879895:0:10003:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789427760.880123:0:10003:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789427761.429713:0:10051:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427761.429723:0:10051:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789427761.456609:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939997184:0@lo:41: 00000100:00100000:3.0:1789427761.456666:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427761.457344:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997184 00000100:00100000:1.0:1789427761.457352:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997184 00000100:00100000:1.0:1789427761.457396:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789427761.457405:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939997184:12345-0@lo:41: 00000004:00000024:1.0:1789427761.457493:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789427761.457590:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939997184:12345-0@lo:41: Request processed in 187us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.457595:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427761.458026:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939997184:0@lo:41: 00010000:00010000:3.0:1789427761.584547:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427761.620353:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427761.620576:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931566720 00000100:00100000:1.0:1789427761.620591:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931566720 00000100:00100000:1.0:1789427761.620664:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:1.0:1789427761.620674:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1876350931566720:12345-192.168.202.24@tcp:250: 00010000:00080000:1.0:1789427761.620715:0:6475:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0bd1cb55-1ed6-4846-a08c-32b278fa2427@192.168.202.24@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:1.0:1789427761.620748:0:6475:0:(genops.c:1384:class_connect()) connect: client 0bd1cb55-1ed6-4846-a08c-32b278fa2427, cookie 0x84fc867ede5182d0 00000100:00080000:1.0:1789427761.620910:0:6475:0:(import.c:65:import_set_state_nolock()) ffff9195837e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427761.620972:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+5:2393:x1876350931566720:12345-192.168.202.24@tcp:250: Request processed in 297us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.620981:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:0.0:1789427761.622884:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.622980:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931566848 00000100:00100000:2.0:1789427761.622992:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931566848 00000100:00100000:2.0:1789427761.623043:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:2.0:1789427761.623052:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+5:6142:x1876350931566848:12345-192.168.202.24@tcp:101: 00010000:00010000:2.0:1789427761.623115:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427761.623141:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73009cb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427761.623169:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427761.623180:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427761.623189:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429000, rc 0) 00000100:00100000:2.0:1789427761.623251:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+6:6142:x1876350931566848:12345-192.168.202.24@tcp:101: Request processed in 200us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.623260:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:0.0:1789427761.624208:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427761.624272:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931566976 00000100:00100000:1.0:1789427761.624279:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931566976 00000100:00100000:1.0:1789427761.624315:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:1.0:1789427761.624325:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+6:6142:x1876350931566976:12345-192.168.202.24@tcp:501: 00000100:00100000:1.0:1789427761.624497:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+6:6142:x1876350931566976:12345-192.168.202.24@tcp:501: Request processed in 173us (290us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427761.624505:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:1.0:1789427761.626818:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427761.626950:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567104 00000100:00100000:0.0:1789427761.626956:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567104 00000100:00100000:0.0:1789427761.626995:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:0.0:1789427761.627004:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+6:6142:x1876350931567104:12345-192.168.202.24@tcp:101: 00010000:00010000:0.0:1789427761.627015:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427761.627034:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73009d2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427761.627062:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427761.627086:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427761.627096:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209a00, rc 0) 00000100:00100000:0.0:1789427761.627141:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+7:6142:x1876350931567104:12345-192.168.202.24@tcp:101: Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427761.627161:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:3.0:1789427761.628374:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427761.628545:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567232 00000100:00100000:1.0:1789427761.628550:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567232 00000100:00100000:1.0:1789427761.628584:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1789427761.628593:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+7:6142:x1876350931567232:12345-192.168.202.24@tcp:501: 00000100:00100000:1.0:1789427761.628736:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6142:x1876350931567232:12345-192.168.202.24@tcp:501: Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.628746:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1789427761.637396:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.637615:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567360 00000100:00100000:2.0:1789427761.637627:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567360 00000100:00100000:2.0:1789427761.637692:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:2.0:1789427761.637703:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6142:x1876350931567360:12345-192.168.202.24@tcp:503: 00000100:00100000:2.0:1789427761.637907:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6142:x1876350931567360:12345-192.168.202.24@tcp:503: Request processed in 205us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.637915:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:2.0:1789427761.640741:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427761.640875:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567488 00000100:00100000:1.0:1789427761.640886:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567488 00000100:00100000:1.0:1789427761.640960:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:1.0:1789427761.640970:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6160:x1876350931567488:12345-192.168.202.24@tcp:502: 00000100:00100000:1.0:1789427761.641817:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6160:x1876350931567488:12345-192.168.202.24@tcp:502: Request processed in 845us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.641827:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:3.0:1789427761.666255:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427761.667471:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567616 00000100:00100000:0.0:1789427761.667487:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567616 00000100:00100000:0.0:1789427761.667562:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:0.0:1789427761.667575:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6160:x1876350931567616:12345-192.168.202.24@tcp:502: 00000100:00100000:0.0:1789427761.667792:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6160:x1876350931567616:12345-192.168.202.24@tcp:502: Request processed in 219us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427761.667800:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:0.0:1789427761.671117:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427761.671223:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567744 00000100:00100000:1.0:1789427761.671236:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567744 00000100:00100000:1.0:1789427761.671291:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:1.0:1789427761.671304:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6142:x1876350931567744:12345-192.168.202.24@tcp:101: 00010000:00010000:1.0:1789427761.671321:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427761.671342:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ed000/0x84fc867ede5182e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a03 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427761.671845:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed000/0x84fc867ede5182e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a03 expref: 9 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427761.671865:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ed000/0x84fc867ede5182e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a03 expref: 9 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427761.671878:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed000, rc 0) 00000100:00100000:1.0:1789427761.671952:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6142:x1876350931567744:12345-192.168.202.24@tcp:101: Request processed in 651us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.671959:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:1.0:1789427761.674132:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.674314:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931567872 00000100:00100000:2.0:1789427761.674325:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931567872 00000100:00100000:2.0:1789427761.674374:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:2.0:1789427761.674384:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6142:x1876350931567872:12345-192.168.202.24@tcp:256: 20000000:01000000:2.0:1789427761.674408:0:6477:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789427761.674465:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789427761.674470:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789427761.674477:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789427761.674481:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789427761.674483:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789427761.675450:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6142:x1876350931567872:12345-192.168.202.24@tcp:256: Request processed in 1064us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.675460:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:1.0:1789427761.677410:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427761.677513:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568000 00000100:00100000:3.0:1789427761.677521:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568000 00000100:00100000:3.0:1789427761.677560:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:3.0:1789427761.677570:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6142:x1876350931568000:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1789427761.677584:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427761.677607:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a0a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427761.677650:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427761.677664:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427761.677674:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680031000, rc 0) 00000100:00100000:3.0:1789427761.677718:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6142:x1876350931568000:12345-192.168.202.24@tcp:101: Request processed in 148us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427761.677725:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:1.0:1789427761.678711:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.678789:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568128 00000100:00100000:2.0:1789427761.678793:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568128 00000100:00100000:2.0:1789427761.678848:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:2.0:1789427761.678856:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6142:x1876350931568128:12345-192.168.202.24@tcp:501: 00000100:00100000:2.0:1789427761.679020:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6142:x1876350931568128:12345-192.168.202.24@tcp:501: Request processed in 164us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.679028:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:2.0:1789427761.680006:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427761.680058:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568256 00000100:00100000:0.0:1789427761.680064:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568256 00000100:00100000:0.0:1789427761.680097:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:0.0:1789427761.680106:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6142:x1876350931568256:12345-192.168.202.24@tcp:503: 00000100:00100000:0.0:1789427761.680224:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6142:x1876350931568256:12345-192.168.202.24@tcp:503: Request processed in 118us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427761.680231:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:1.0:1789427761.681801:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.681869:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568384 00000100:00100000:2.0:1789427761.681876:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568384 00000100:00100000:2.0:1789427761.681942:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:2.0:1789427761.681951:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6166:x1876350931568384:12345-192.168.202.24@tcp:502: 00000100:00100000:2.0:1789427761.682050:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6166:x1876350931568384:12345-192.168.202.24@tcp:502: Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.682056:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:1.0:1789427761.683253:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427761.683833:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568512 00000100:00100000:0.0:1789427761.683839:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568512 00000100:00100000:0.0:1789427761.683874:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:0.0:1789427761.683883:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6166:x1876350931568512:12345-192.168.202.24@tcp:502: 00000100:00100000:0.0:1789427761.683967:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6166:x1876350931568512:12345-192.168.202.24@tcp:502: Request processed in 84us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427761.683975:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:0.0:1789427761.686075:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427761.686103:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427761.686136:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568640 00000100:00100000:1.0:1789427761.686199:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568896 00000100:00100000:1.0:1789427761.686204:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568896 00000100:00100000:2.0:1789427761.686244:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568640 00000100:00100000:1.0:1789427761.686257:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789427761.686288:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789427761.686295:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931568640:12345-192.168.202.24@tcp:38: 00000100:00100000:1.0:1789427761.686322:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1876350931568896:12345-192.168.202.24@tcp:38: 00010000:00080000:2.0:1789427761.686323:0:6482:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 106 last 0 00010000:00080000:1.0:1789427761.686337:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:2.0:1789427761.686381:0:6482:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede5182f3 00000020:00000080:1.0:1789427761.686393:0:6484:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede5182fa 00000004:00100000:1.0:1789427761.686438:0:6484:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:2.0:1789427761.686440:0:6482:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789427761.686677:0:6482:0:(import.c:65:import_set_state_nolock()) ffff9195837aa800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789427761.686693:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9195837e1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427761.687115:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931568640:12345-192.168.202.24@tcp:38: Request processed in 817us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.687115:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931568896:12345-192.168.202.24@tcp:38: Request processed in 792us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.687124:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1789427761.687127:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00010000:00010000:0.0:1789427762.608927:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427762.691291:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427762.691325:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427762.691349:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427762.691383:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569152 00000100:00100000:0.0:1789427762.691383:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931568768 00000100:00100000:3.0:1789427762.691396:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569152 00000100:00100000:0.0:1789427762.691397:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931568768 00000100:00100000:2.0:1789427762.691410:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569024 00000100:00080000:1.0:1789427762.691477:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427762.691478:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569024 00000100:00080000:1.0:1789427762.691508:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427762.691524:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:0.0:1789427762.691535:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789427762.691541:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:6142:x1876350931569152:12345-192.168.202.24@tcp:41: 00000100:00100000:0.0:1789427762.691552:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:0:x1876350931568768:12345-192.168.202.24@tcp:41: 00000004:00000024:0.0:1789427762.691593:0:8108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:3.0:1789427762.691594:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789427762.691683:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:0:x1876350931568768:12345-192.168.202.24@tcp:41: Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427762.691685:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:6142:x1876350931569152:12345-192.168.202.24@tcp:41: Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427762.691694:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789427762.691701:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:0.0:1789427762.691717:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1789427762.691725:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:0:x1876350931569024:12345-192.168.202.24@tcp:41: 00000004:00000024:0.0:1789427762.691744:0:8108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789427762.691772:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:0:x1876350931569024:12345-192.168.202.24@tcp:41: Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427762.691779:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1789427762.693369:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427762.693440:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569280 00000100:00100000:2.0:1789427762.693446:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569280 00000100:00100000:2.0:1789427762.693480:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789427762.693490:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569280:12345-192.168.202.24@tcp:40: 00000100:00100000:2.0:1789427762.693548:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569280:12345-192.168.202.24@tcp:40: Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427762.693555:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789427762.694552:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427762.694585:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427762.694644:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569408 00000100:00100000:0.0:1789427762.694649:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569536 00000100:00100000:0.0:1789427762.694659:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569536 00000100:00100000:3.0:1789427762.694664:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569408 00000100:00100000:2.0:1789427762.694705:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427762.694707:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:3.0:1789427762.694721:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569664 00000100:00100000:0.0:1789427762.694722:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931569536:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1789427762.694732:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569664 00000100:00100000:1.0:1789427762.694742:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1789427762.694754:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1876350931569408:12345-192.168.202.24@tcp:8: 00000100:00100000:2.0:1789427762.694759:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789427762.694769:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1876350931569664:12345-192.168.202.24@tcp:8: 00000100:00100000:0.0:1789427762.694782:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931569536:12345-192.168.202.24@tcp:400: Request processed in 64us (193us total) trans 0 rc 0/0 00010000:00080000:1.0:1789427762.694789:0:8902:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 107 last 0 00010000:00080000:2.0:1789427762.694791:0:8401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 107 last 0 00000100:00100000:0.0:1789427762.694792:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 187 00000020:00000080:2.0:1789427762.694840:0:8401:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede518301 00000020:00000080:1.0:1789427762.694840:0:8902:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede518308 00002000:00100000:2.0:1789427762.694855:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f916dfa-5c35-44f7-8247-070d65680205/ffff9195837af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789427762.694861:0:8902:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f916dfa-5c35-44f7-8247-070d65680205/ffff9195837e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789427762.694874:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1789427762.694879:0:8902:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789427762.695151:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1789427762.695158:0:8902:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789427762.695189:0:8401:0:(import.c:65:import_set_state_nolock()) ffff9195837a9000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789427762.695189:0:8902:0:(import.c:65:import_set_state_nolock()) ffff919583036800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427762.695245:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931569664:12345-192.168.202.24@tcp:8: Request processed in 478us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427762.695249:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931569408:12345-192.168.202.24@tcp:8: Request processed in 494us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427762.695263:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1789427762.695276:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789427762.696292:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427762.696370:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569792 00000100:00100000:3.0:1789427762.696379:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569792 00000100:00100000:3.0:1789427762.696464:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:3.0:1789427762.696475:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569792:12345-192.168.202.24@tcp:900: 00000100:00100000:3.0:1789427762.696558:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569792:12345-192.168.202.24@tcp:900: Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427762.696573:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1789427762.697517:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427762.697599:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931569920 00000100:00100000:2.0:1789427762.697605:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931569920 00000100:00100000:2.0:1789427762.697679:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789427762.697688:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569920:12345-192.168.202.24@tcp:33: 00000004:00080000:0.0:1789427762.717891:0:6485:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20128us 00000004:00200000:0.0:1789427762.727819:0:6485:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789427762.727935:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:6142:x1876350931569920:12345-192.168.202.24@tcp:33: Request processed in 30243us (30414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427762.727950:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1789427762.798250:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427762.798467:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570048 00000100:00100000:3.0:1789427762.798477:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570048 00000100:00100000:3.0:1789427762.798529:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1789427762.798539:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:6184:x1876350931570048:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1789427762.798559:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427762.798616:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51830f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a3b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798701:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798716:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798731:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427762.798777:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789427762.798782:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427762.798796:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798891:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51830f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a3b expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798912:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a3b expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427762.798933:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f000) 00010000:00010000:3.0:1789427762.798937:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427762.798941:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b800, rc 0) 00000100:00100000:3.0:1789427762.799013:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:6184:x1876350931570048:12345-192.168.202.24@tcp:101: Request processed in 475us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427762.799020:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00010000:00010000:2.0:1789427763.632633:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427764.016588:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427764.016617:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939997312:0@lo:41: 00000100:00100000:2.0:1789427764.016681:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.016757:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997312 00000100:00100000:2.0:1789427764.016766:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997312 00000100:00100000:2.0:1789427764.016812:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427764.016821:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939997312:12345-0@lo:41: 00000004:00000024:2.0:1789427764.016854:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427764.016899:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939997312:12345-0@lo:41: Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.016907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427764.016951:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939997312:0@lo:41: 00000100:00100000:1.0:1789427764.439790:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427764.439884:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570176 00000100:00100000:2.0:1789427764.439894:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570176 00000100:00100000:2.0:1789427764.440005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1789427764.440015:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:6236:x1876350931570176:12345-192.168.202.24@tcp:41: 00000004:00000024:2.0:1789427764.440052:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789427764.440127:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:6236:x1876350931570176:12345-192.168.202.24@tcp:41: Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.440159:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00080000:1.0:1789427764.441441:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427764.445686:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427764.445738:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570304 00000100:00100000:3.0:1789427764.445747:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570304 00000100:00100000:3.0:1789427764.445817:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1789427764.445827:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570304:12345-192.168.202.24@tcp:41: 00000004:00000024:3.0:1789427764.445854:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427764.445918:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570304:12345-192.168.202.24@tcp:41: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427764.445926:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:1.0:1789427764.445981:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427764.447772:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427764.447828:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570432 00000100:00100000:0.0:1789427764.447834:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570432 00000100:00080000:1.0:1789427764.447911:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427764.447936:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789427764.447946:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570432:12345-192.168.202.24@tcp:13: 00002000:00000024:0.0:1789427764.447962:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427764.448006:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570432:12345-192.168.202.24@tcp:13: Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.448013:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789427764.449070:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427764.449159:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570560 00000100:00100000:3.0:1789427764.449164:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570560 00000100:00100000:3.0:1789427764.449259:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1789427764.449267:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570560:12345-192.168.202.24@tcp:13: 00002000:00000024:3.0:1789427764.449279:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427764.449323:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f916dfa-5c35-44f7-8247-070d65680205+6:6236:x1876350931570560:12345-192.168.202.24@tcp:13: Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427764.449329:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00080000:1.0:1789427764.449403:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427764.528583:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427764.528607:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939997824:0@lo:400: 00000100:00100000:2.0:1789427764.528617:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350939997952:0@lo:400: 00000100:00100000:3.0:1789427764.528640:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939997440:0@lo:13: 00000100:00100000:0.0:1789427764.528678:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.528684:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427764.528699:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528752:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997824 00000100:00100000:2.0:1789427764.528754:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939998464:0@lo:400: 00000100:00100000:3.0:1789427764.528755:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939998080:0@lo:400: 00000100:00100000:0.0:1789427764.528758:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939997568:0@lo:400: 00000100:00100000:1.0:1789427764.528762:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997824 00000100:00100000:3.0:1789427764.528812:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.528812:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528819:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789427764.528821:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528832:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939997824:12345-0@lo:400: 00000100:00100000:3.0:1789427764.528851:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939998592:0@lo:400: 00000100:00100000:2.0:1789427764.528853:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939998976:0@lo:400: 00000100:00100000:0.0:1789427764.528862:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350939998336:0@lo:400: 00000100:00100000:3.0:1789427764.528889:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528909:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939997824:12345-0@lo:400: Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427764.528917:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427764.528919:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939999104:0@lo:400: 00000100:00100000:0.0:1789427764.528929:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.528932:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528942:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998080 00000100:00100000:1.0:1789427764.528947:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998080 00000100:00100000:0.0:1789427764.528958:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350939998848:0@lo:400: 00000100:00100000:3.0:1789427764.528963:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.528972:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427764.528981:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998464 00000100:00100000:2.0:1789427764.528987:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998464 00000100:00100000:1.0:1789427764.528997:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939998080:12345-0@lo:400: 00000100:00100000:3.0:1789427764.529002:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789427764.529007:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427764.529016:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939997696:0@lo:400: 00000100:00100000:2.0:1789427764.529043:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998592 00000100:00100000:1.0:1789427764.529048:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939998080:12345-0@lo:400: Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.529049:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998592 00000100:00100000:0.0:1789427764.529051:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939997824:0@lo:400: 00000100:00100000:3.0:1789427764.529053:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.529063:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427764.529075:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998976 00000100:00100000:2.0:1789427764.529080:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998976 00000100:00100000:3.0:1789427764.529086:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350939998208:0@lo:400: 00000100:00100000:1.0:1789427764.529095:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999104 00000100:00100000:0.0:1789427764.529099:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997952 00000100:00100000:1.0:1789427764.529100:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999104 00000100:00100000:0.0:1789427764.529106:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997952 00000100:00100000:2.0:1789427764.529108:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789427764.529123:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939998464:12345-0@lo:400: 00000100:00100000:3.0:1789427764.529125:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427764.529133:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427764.529137:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998336 00000100:00100000:0.0:1789427764.529142:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998336 00000100:00100000:1.0:1789427764.529144:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939998592:12345-0@lo:400: 00000100:00100000:3.0:1789427764.529148:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350939998720:0@lo:400: 00000100:00100000:2.0:1789427764.529173:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939998464:12345-0@lo:400: Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.529177:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998848 00000100:00100000:0.0:1789427764.529183:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998848 00000100:00100000:3.0:1789427764.529195:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.529199:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427764.529214:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939999232:0@lo:13: 00000100:00100000:2.0:1789427764.529224:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427764.529226:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997696 00000100:00100000:0.0:1789427764.529230:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997696 00000100:00100000:3.0:1789427764.529239:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.529239:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939998976:12345-0@lo:400: 00000100:00100000:1.0:1789427764.529240:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939998592:12345-0@lo:400: Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.529247:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998208 00000100:00100000:0.0:1789427764.529252:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998208 00010000:00080000:3.0:1789427764.529262:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68380 x1876350939998592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427764.529263:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789427764.529274:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939998592:0@lo:400: 00000100:00100000:0.0:1789427764.529274:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939998720 00000100:00100000:0.0:1789427764.529280:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939998720 00000100:00100000:1.0:1789427764.529291:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427764.529295:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939998080:0@lo:400: 00000100:00100000:2.0:1789427764.529299:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350939998976:12345-0@lo:400: Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427764.529303:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939999104:12345-0@lo:400: 00000100:00100000:0.0:1789427764.529308:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427764.529315:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427764.529320:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350939997952:12345-0@lo:400: 00000100:00100000:3.0:1789427764.529329:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997440 00000100:00100000:3.0:1789427764.529334:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997440 00000100:00080000:2.0:1789427764.529341:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427764.529347:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427764.529351:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427764.529355:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427764.529356:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999232 00000100:00100000:1.0:1789427764.529358:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350939999104:12345-0@lo:400: Request processed in 58us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427764.529359:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999232 00000100:00100000:1.0:1789427764.529372:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427764.529377:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427764.529378:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350939997952:12345-0@lo:400: Request processed in 57us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.529387:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427764.529393:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939997440:12345-0@lo:13: 00000100:00100000:0.0:1789427764.529394:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427764.529400:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350939998336:12345-0@lo:400: 00000100:00100000:1.0:1789427764.529412:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939997568 00002000:00000024:3.0:1789427764.529434:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427764.529439:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427764.529449:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350939998848:12345-0@lo:400: 00000100:00100000:1.0:1789427764.529451:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939997568 00000100:00100000:2.0:1789427764.529472:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350939998336:12345-0@lo:400: Request processed in 75us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427764.529480:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939997440:12345-0@lo:13: Request processed in 88us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.529482:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789427764.529492:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789427764.529494:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427764.529498:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350939998848:12345-0@lo:400: Request processed in 50us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.529507:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789427764.529508:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350939997568:12345-0@lo:400: 00000100:00100000:2.0:1789427764.529515:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427764.529517:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427764.529524:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789427764.529530:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939999232:12345-0@lo:13: 00000100:00100000:2.0:1789427764.529531:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939997696:12345-0@lo:400: 00000100:00100000:0.0:1789427764.529535:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350939998208:12345-0@lo:400: 00002000:00000024:3.0:1789427764.529546:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427764.529553:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350939997568:12345-0@lo:400: Request processed in 49us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427764.529560:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789427764.529596:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350939997696:12345-0@lo:400: Request processed in 71us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.529600:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350939998208:12345-0@lo:400: Request processed in 68us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427764.529601:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350939999232:12345-0@lo:13: Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427764.529612:0:8108:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789427764.529613:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427764.529616:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427764.529622:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789427764.529624:0:8108:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789427764.529640:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789427764.529652:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350939998720:12345-0@lo:400: 00000100:00100000:3.0:1789427764.529665:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350939997696:0@lo:400: 00010000:00080000:1.0:1789427764.529665:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6bb80 x1876350939998336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427764.529682:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350939998336:0@lo:400: 00000100:00100000:3.0:1789427764.529683:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350939998208:0@lo:400: 00000100:00100000:2.0:1789427764.529691:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350939998720:12345-0@lo:400: Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.529699:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789427764.529709:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68000 x1876350939998848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789427764.529752:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb69500 x1876350939998464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427764.529756:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350939998720:0@lo:400: 00000100:00100000:2.0:1789427764.529771:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939998464:0@lo:400: 00010000:00080000:3.0:1789427764.529776:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6b800 x1876350939999232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427764.529783:0:3613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00010000:00080000:2.0:1789427764.529791:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb69f80 x1876350939998976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427764.529796:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350939999232:0@lo:13: 00000100:00100000:2.0:1789427764.529809:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350939998976:0@lo:400: 00010000:00080000:3.0:1789427764.529811:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6b100 x1876350939999104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427764.529819:0:3613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789427764.529826:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939999104:0@lo:400: 00000100:00100000:1.0:1789427764.529826:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350939998848:0@lo:400: 00000100:00100000:2.0:1789427764.529830:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350939997952:0@lo:400: 00010000:00080000:3.0:1789427764.529849:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bd880 x1876350939997440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427764.529855:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350939997568:0@lo:400: 00000100:00100000:3.0:1789427764.529871:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939997440:0@lo:13: 00010000:00010000:0.0:1789427764.656732:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427765.552588:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939999488:0@lo:13: 00000100:00100000:2.0:1789427765.552588:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939999360:0@lo:13: 00000100:00100000:2.0:1789427765.552682:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427765.552723:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999360 00000100:00100000:3.0:1789427765.552732:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427765.552734:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999360 00000100:00100000:0.0:1789427765.552780:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999488 00000100:00100000:0.0:1789427765.552787:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999488 00000100:00100000:1.0:1789427765.552794:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427765.552816:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939999360:12345-0@lo:13: 00002000:00000024:1.0:1789427765.552858:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427765.552916:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350939999360:12345-0@lo:13: Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.552923:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427765.552947:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427765.552955:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939999488:12345-0@lo:13: 00010000:00080000:2.0:1789427765.552963:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196a9808a80 x1876350939999360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1789427765.552967:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427765.552991:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350939999360:0@lo:13: 00000100:00100000:1.0:1789427765.553005:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350939999488:12345-0@lo:13: Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.553013:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789427765.553040:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc83b80 x1876350939999488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427765.553055:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350939999488:0@lo:13: 00010000:00010000:3.0:1789427765.680529:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427765.790896:0:10150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789427766.577924:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427766.578007:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939999616:0@lo:41: 00000100:00100000:0.0:1789427766.578108:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427766.578206:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999616 00000100:00100000:1.0:1789427766.578219:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999616 00000100:00100000:1.0:1789427766.578282:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789427766.578300:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939999616:12345-0@lo:41: 00000004:00000024:1.0:1789427766.578343:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789427766.578541:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350939999616:12345-0@lo:41: Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427766.578550:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427766.578618:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350939999616:0@lo:41: 00010000:00010000:0.0:1789427766.705518:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427767.601723:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000001:00100000:1.0:1789427767.601733:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000001:00100000:0.0:1789427767.601758:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00010000:00010000:2.0:1789427767.728641:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427767.779111:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427767.779178:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427767.779215:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570816 00000100:00100000:1.0:1789427767.779218:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427767.779226:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570816 00000100:00100000:1.0:1789427767.779252:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427767.779292:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570944 00000100:00100000:1.0:1789427767.779296:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427767.779297:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570944 00000100:00100000:1.0:1789427767.779330:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571072 00000100:00100000:2.0:1789427767.779333:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1789427767.779349:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:2.0:1789427767.779362:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931570816:12345-192.168.202.24@tcp:400: 00000100:00100000:0.0:1789427767.779366:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931570944:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1789427767.779383:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931570688 00000100:00100000:3.0:1789427767.779389:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931570688 00000100:00100000:3.0:1789427767.779465:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:3.0:1789427767.779474:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2395:x1876350931570688:12345-192.168.202.24@tcp:400: 00000100:00100000:0.0:1789427767.779481:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931570944:12345-192.168.202.24@tcp:400: Request processed in 122us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.779487:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00080000:0.0:1789427767.779506:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427767.779508:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931570816:12345-192.168.202.24@tcp:400: Request processed in 159us (402us total) trans 0 rc 0/0 00000100:00080000:0.0:1789427767.779510:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427767.779519:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2395:x1876350931570688:12345-192.168.202.24@tcp:400: Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.779528:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:3.0:1789427767.779535:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:3.0:1789427767.779585:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571200 00000100:00100000:3.0:1789427767.779589:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571200 00000100:00080000:0.0:1789427767.779635:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427767.779645:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1789427767.779654:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931571200:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1789427767.779744:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931571200:12345-192.168.202.24@tcp:400: Request processed in 90us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427767.779751:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1789427767.779830:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571072 00000100:00100000:1.0:1789427767.779893:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00080000:0.0:1789427767.779896:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427767.779905:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931571072:12345-192.168.202.24@tcp:400: 00000100:00100000:1.0:1789427767.779943:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931571072:12345-192.168.202.24@tcp:400: Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427767.779950:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000001:00100000:3.0:1789427768.625361:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00010000:00010000:0.0:1789427768.752561:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427769.136769:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427769.136810:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939999744:0@lo:41: 00000100:00100000:0.0:1789427769.136899:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.136956:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350939999744 00000100:00100000:2.0:1789427769.136969:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350939999744 00000100:00100000:2.0:1789427769.137024:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789427769.137036:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939999744:12345-0@lo:41: 00000004:00000024:2.0:1789427769.137076:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427769.137159:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350939999744:12345-0@lo:41: Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.137167:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427769.137262:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350939999744:0@lo:41: 00000020:00000080:2.0:1789427769.388063:0:10297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff63447230 20000000:00000080:2.0:1789427769.388079:0:10297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196ae8bfc00 uarg=0000000000000000 20000000:01000000:2.0:1789427769.388122:0:10297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789427769.388124:0:10297:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789427769.388127:0:10297:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789427769.388131:0:10297:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789427769.388136:0:10297:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789427769.388205:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789427769.388208:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427769.388614:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789427769.388875:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789427769.388919:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789427769.388933:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789427769.388943:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789427769.388946:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427769.389196:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789427769.389307:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789427769.389327:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789427769.389344:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789427769.389355:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789427769.389356:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427769.389602:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789427769.389677:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789427769.389699:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789427769.389714:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789427769.389722:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789427769.389736:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427769.390133:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789427769.390247:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789427769.390269:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789427769.390283:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789427769.390291:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789427769.390292:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427769.390511:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789427769.390719:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789427769.390814:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789427769.390829:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1789427769.390841:0:10297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789427769.390859:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390887:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390895:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181db expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390901:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51821a expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390908:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390915:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518236 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390921:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518252 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390929:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518275 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390935:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518298 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390941:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390951:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390969:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.390976:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391021:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391035:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 9 pid: 6478 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.391049:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350939999872:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427769.391166:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391175:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 9 pid: 6477 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.391186:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000000:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427769.391229:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391239:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 23 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.391249:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000128:0@lo:104: 00000100:00100000:1.0:1789427769.391285:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427769.391323:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.391324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000128 00000100:00100000:0.0:1789427769.391332:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000128 00010000:00010000:1.0:1789427769.391336:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.391348:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000256:0@lo:104: 00000100:00100000:1.0:1789427769.391369:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427769.391397:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391407:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.391431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000256 00000100:00100000:0.0:1789427769.391435:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000256 00000100:00100000:1.0:1789427769.391447:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000384:0@lo:104: 00000100:00100000:1.0:1789427769.391472:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.391477:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000384 00000100:00100000:3.0:1789427769.391484:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000384 00000100:00100000:0.0:1789427769.391497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789427769.391509:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940000128:12345-0@lo:104: 00010000:00010000:1.0:1789427769.391510:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.391514:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789427769.391526:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.391529:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 23 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.391530:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940000256:12345-0@lo:104: 00010000:00010000:3.0:1789427769.391546:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.391553:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000512:0@lo:104: 00000100:00100000:1.0:1789427769.392273:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427769.392300:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392307:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789427769.392311:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 23 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.392315:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427769.392318:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940000128:12345-0@lo:104: Request processed in 810us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.392327:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940000256:12345-0@lo:104: Request processed in 800us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427769.392334:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000640:0@lo:104: 00000100:00100000:0.0:1789427769.392336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427769.392343:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427769.392361:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789427769.392371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000512 00000100:00100000:0.0:1789427769.392374:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000512 00000100:00100000:3.0:1789427769.392377:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:3.0:1789427769.392393:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789427769.392404:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:10297:x1876350940000384:12345-0@lo:104: 00000100:00100000:0.0:1789427769.392404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427769.392434:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae84b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:10297:x1876350940000512:12345-0@lo:104: 00010000:00010000:3.0:1789427769.392438:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392444:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392482:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789427769.392487:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae84b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:10297:x1876350940000512:12345-0@lo:104: Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.392492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789427769.392506:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427769.392511:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392519:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.392524:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392533:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.392544:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.392556:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789427769.392563:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789427769.392569:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.392574:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10297:x1876350940000384:12345-0@lo:104: Request processed in 172us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.392583:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789427769.392585:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392593:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.392614:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392621:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5182c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5182c9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.392622:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000640 00000100:00100000:3.0:1789427769.392628:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000640 00010000:00010000:0.0:1789427769.392639:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427769.392644:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.392649:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789427769.392656:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209c00 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:3.0:1789427769.392660:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10297:x1876350940000640:12345-0@lo:104: 10000000:00010000:0.0:1789427769.392661:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.392671:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392672:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.392687:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.392702:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.392729:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392735:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.392747:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392754:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51829f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392765:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427769.392768:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.392782:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789427769.392790:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed800 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:3.0:1789427769.392793:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10297:x1876350940000640:12345-0@lo:104: Request processed in 134us (226us total) trans 0 rc 0/0 10000000:00010000:0.0:1789427769.392795:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.392808:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789427769.392810:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.392817:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.392823:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427769.392827:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.392839:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392841:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392854:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789427769.392856:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001024:0@lo:104: 00010000:00010000:0.0:1789427769.392875:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.392886:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427769.392888:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede518252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518259 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392901:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427769.392910:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.392915:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392920:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.392925:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.392930:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 23 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392937:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.392943:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001280:0@lo:104: 10000000:00010000:0.0:1789427769.392950:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.392956:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789427769.392968:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427769.392973:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392979:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.392985:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.392992:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede518275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51827c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393000:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427769.393003:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393009:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.393011:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393028:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.393034:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.393039:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.393052:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393058:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.393062:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393068:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919680030800/0x84fc867ede518236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51823d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393078:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427769.393079:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427769.393081:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427769.393088:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427769.393097:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940000896:0@lo:103: 00000100:00100000:0.0:1789427769.393126:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427769.393179:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.393188:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 23 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.393197:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001664:0@lo:104: 00010000:00010000:2.0:1789427769.393449:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427769.393457:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427769.393475:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940000768:0@lo:103: 00000100:00100000:3.0:1789427769.393547:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940001152:0@lo:103: 00000100:00100000:1.0:1789427769.393548:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.393565:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000896 00000100:00100000:0.0:1789427769.393571:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000896 00010000:00010000:1.0:1789427769.393578:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.393587:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427769.393593:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 24 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.393597:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 24 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.393624:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001152 00000100:00100000:1.0:1789427769.393626:0:10297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001792:0@lo:104: 00000100:00100000:0.0:1789427769.393637:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001152 00010000:00010000:0.0:1789427769.393655:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 25 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.393665:0:10297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.393680:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789427769.393682:0:10297:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427769.393691:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688834850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3616:x1876350940000896:12345-0@lo:103: 00000100:00100000:1.0:1789427769.393701:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000128:0@lo:104: 00000100:00100000:1.0:1789427769.393710:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000256:0@lo:104: 00010000:00010000:0.0:1789427769.393713:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427769.393718:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000384:0@lo:104: 00010000:00010000:0.0:1789427769.393721:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 25 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393731:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 25 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.393737:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789427769.393744:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428e00/0x84fc867ede51829f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518298 expref: 25 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.393750:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940001408:0@lo:103: 00010000:00010000:0.0:1789427769.393758:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427769.393789:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.393800:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688834850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940000896:12345-0@lo:103: Request processed in 111us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.393808:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789427769.393835:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000512:0@lo:104: 00000100:00100000:1.0:1789427769.393848:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000640:0@lo:104: 00000100:00100000:3.0:1789427769.393854:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001408 00000100:00100000:3.0:1789427769.393859:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001408 00000100:00100000:0.0:1789427769.393860:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427769.393871:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940001152:12345-0@lo:103: 00010000:00010000:0.0:1789427769.393879:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427769.393885:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 24 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393893:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 24 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393903:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428000/0x84fc867ede518259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518252 expref: 24 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.393917:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427769.393934:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 24 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.393945:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3613:x1876350940001152:12345-0@lo:103: Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.393953:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789427769.393959:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789427769.393969:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3613:x1876350940001408:12345-0@lo:103: 00000100:00100000:0.0:1789427769.393998:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940000896:0@lo:103: 00000100:00100000:0.0:1789427769.394022:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940001152:0@lo:103: 00000100:00100000:0.0:1789427769.394040:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001024 00000100:00100000:0.0:1789427769.394044:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001024 00010000:00010000:3.0:1789427769.394048:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427769.394055:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 22 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.394061:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001280 00010000:00010000:3.0:1789427769.394066:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 22 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.394066:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001280 00010000:00010000:3.0:1789427769.394081:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428600/0x84fc867ede51827c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518275 expref: 22 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.394081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001664 00000100:00100000:0.0:1789427769.394086:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001664 00010000:00010000:3.0:1789427769.394096:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427769.394101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001792 00000100:00100000:0.0:1789427769.394105:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001792 00000100:00100000:0.0:1789427769.394125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427769.394132:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:10297:x1876350940001024:12345-0@lo:104: 00010000:00010000:0.0:1789427769.394153:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.394191:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940001408:0@lo:103: 00010000:00010000:0.0:1789427769.394200:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427769.394207:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:10297:x1876350940001024:12345-0@lo:104: Request processed in 75us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.394214:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3613:x1876350940001408:12345-0@lo:103: Request processed in 245us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.394219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427769.394228:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427769.394241:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001024:0@lo:104: 00000100:00100000:0.0:1789427769.394245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427769.394257:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940001280:12345-0@lo:104: 00000100:00100000:3.0:1789427769.394262:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789427769.394268:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.394272:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940001664:12345-0@lo:104: 00010000:00010000:3.0:1789427769.394282:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394329:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427769.394336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940001280:12345-0@lo:104: Request processed in 82us (1368us total) trans 0 rc 0/0 00010000:00010000:3.0:1789427769.394339:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789427769.394350:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:10297:x1876350940001664:12345-0@lo:104: Request processed in 78us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.394350:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427769.394361:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427769.394378:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789427769.394385:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10297:x1876350940001792:12345-0@lo:104: 00010000:00010000:3.0:1789427769.394393:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394394:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427769.394403:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.394404:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001280:0@lo:104: 00000100:00100000:1.0:1789427769.394443:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001664:0@lo:104: 00010000:00010000:0.0:1789427769.394455:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031800 already unused, calling callback (ffffffffc118ec20) 00000100:00100000:1.0:1789427769.394456:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940001792:0@lo:104: 00010000:00010000:3.0:1789427769.394458:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:0.0:1789427769.394462:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.394470:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10297:x1876350940001792:12345-0@lo:104: Request processed in 84us (804us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427769.394475:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.394480:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 10000000:00010000:0.0:1789427769.394488:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.394495:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.394517:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394524:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.394538:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394544:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919680031800/0x84fc867ede518228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51822f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394566:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427769.394570:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.394573:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940001920:0@lo:103: 00010000:00010000:0.0:1789427769.394584:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813edc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.394587:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394595:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.394603:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.394606:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789427769.394614:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.394633:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394639:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.394652:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394659:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813edc00/0x84fc867ede51821a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518221 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394669:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427769.394672:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394687:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.394690:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394697:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.394702:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.394708:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.394720:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394726:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.394730:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394736:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede5181db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181e2 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394744:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427769.394747:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394753:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427769.394755:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394771:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427769.394777:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427769.394782:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427769.394794:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394800:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427769.394813:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394820:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919680031e00/0x84fc867ede5181b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181b8 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.394833:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427769.394834:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427769.394836:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427769.394846:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940002048:0@lo:103: 00000100:00100000:0.0:1789427769.394870:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.394890:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427769.394896:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940002176:0@lo:103: 00000100:00100000:3.0:1789427769.394918:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001920 00000100:00100000:3.0:1789427769.394924:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001920 00000100:00100000:0.0:1789427769.394931:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427769.394941:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 21 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.394956:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002048 00000100:00100000:3.0:1789427769.394960:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002176 00000100:00100000:0.0:1789427769.394962:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002048 00000100:00100000:3.0:1789427769.394966:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002176 00010000:00010000:0.0:1789427769.394980:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 23 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.394984:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 23 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.395010:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427769.395017:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3616:x1876350940001920:12345-0@lo:103: 00010000:00010000:0.0:1789427769.395025:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427769.395029:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395038:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395046:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9400/0x84fc867ede51822f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518228 expref: 23 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395055:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427769.395077:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3616:x1876350940001920:12345-0@lo:103: Request processed in 61us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.395082:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427769.395094:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789427769.395099:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3613:x1876350940002048:12345-0@lo:103: 00010000:00010000:0.0:1789427769.395106:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427769.395110:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 21 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395117:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 21 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395126:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9200/0x84fc867ede518221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51821a expref: 21 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.395155:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427769.395181:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940001920:0@lo:103: 00000100:00100000:1.0:1789427769.395194:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427769.395211:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940002304:0@lo:103: 00000100:00100000:3.0:1789427769.395332:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427769.395340:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3613:x1876350940002176:12345-0@lo:103: 00010000:00010000:3.0:1789427769.395349:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427769.395354:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 20 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.395363:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 20 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.395376:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209e00/0x84fc867ede5181e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5181db expref: 20 pid: 6475 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.395387:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427769.396356:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.396357:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350940002048:12345-0@lo:103: Request processed in 1254us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.396360:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350940002176:12345-0@lo:103: Request processed in 1021us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.396371:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789427769.396378:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427769.396391:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002304 00000100:00100000:0.0:1789427769.396397:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002304 00010000:00010000:0.0:1789427769.396432:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 18 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.396459:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427769.396460:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427769.396472:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3616:x1876350940002304:12345-0@lo:103: 00010000:00010000:0.0:1789427769.396481:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427769.396486:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 18 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.396493:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 18 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.396503:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9800/0x84fc867ede5181b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5181b1 expref: 18 pid: 6477 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427769.396512:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427769.396544:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3616:x1876350940002304:12345-0@lo:103: Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.396552:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789427769.396565:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940002304:0@lo:103: 00000100:00100000:0.0:1789427769.396588:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940002176:0@lo:103: 00000100:00100000:0.0:1789427769.396595:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940002048:0@lo:103: 00000100:00100000:2.0:1789427769.396687:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.396753:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940001536:0@lo:103: 00000100:00100000:3.0:1789427769.396756:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940000768 00000100:00100000:3.0:1789427769.396762:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940000768 00000100:00100000:2.0:1789427769.396774:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427769.396781:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 17 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.396810:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940001536 00000100:00100000:3.0:1789427769.396814:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427769.396815:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940001536 00000100:00100000:3.0:1789427769.396825:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688836050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:3615:x1876350940000768:12345-0@lo:103: 00010000:00010000:3.0:1789427769.396834:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427769.396837:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 18 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.396841:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 18 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.396859:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 18 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.396876:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789427769.396878:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208600/0x84fc867ede5182c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5182c2 expref: 18 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.396888:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3615:x1876350940001536:12345-0@lo:103: 00010000:00010000:3.0:1789427769.396890:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427769.396900:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427769.396905:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 17 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.396914:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 17 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.396931:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688836050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:3615:x1876350940000768:12345-0@lo:103: Request processed in 103us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1789427769.396931:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9000/0x84fc867ede51823d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518236 expref: 17 pid: 6478 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.396941:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940000768:0@lo:103: 00000100:00100000:3.0:1789427769.396946:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789427769.396950:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427769.396989:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3615:x1876350940001536:12345-0@lo:103: Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.396995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789427769.397116:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940001536:0@lo:103: 00000100:00100000:2.0:1789427769.397156:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427769.397182:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571328 00000100:00100000:1.0:1789427769.397187:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571328 00010000:00010000:1.0:1789427769.397215:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 10 pid: 6478 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.397226:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427769.397285:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571456 00000100:00100000:1.0:1789427769.397290:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571456 00010000:00010000:2.0:1789427769.397296:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427769.397305:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 11 pid: 6477 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.397314:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1789427769.397324:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2396:x1876350931571328:12345-192.168.202.24@tcp:103: 00010000:00010000:2.0:1789427769.397334:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427769.397334:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00010000:00010000:2.0:1789427769.397343:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 11 pid: 6478 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427769.397348:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2396:x1876350931571456:12345-192.168.202.24@tcp:103: 00000100:00100000:3.0:1789427769.397355:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350939999872:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427769.397361:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427769.397366:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 11 pid: 6478 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427769.397369:0:10297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876350940000000:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427769.397369:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 11 pid: 6477 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.397394:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209a00/0x84fc867ede5182de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009d2 expref: 11 pid: 6478 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397398:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 11 pid: 6477 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.397432:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397435:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429000/0x84fc867ede5182d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73009cb expref: 10 pid: 6477 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397446:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397454:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.397462:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427769.397468:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397484:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397491:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397498:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397505:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00000100:00100000:2.0:1789427769.397512:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2396:x1876350931571328:12345-192.168.202.24@tcp:103: Request processed in 187us (354us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427769.397512:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397529:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427769.397532:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00010000:00010000:1.0:1789427769.397548:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427769.397558:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427769.397574:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427769.397582:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:2396:x1876350931571456:12345-192.168.202.24@tcp:103: Request processed in 237us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427769.397590:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00010000:00010000:3.0:1789427769.398290:0:10297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.398299:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427769.398306:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ed200/0x84fc867ede51831d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427769.587385:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427769.587486:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571584 00000100:00100000:2.0:1789427769.587495:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571584 00000100:00100000:2.0:1789427769.587581:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:2.0:1789427769.587589:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:6156:x1876350931571584:12345-192.168.202.24@tcp:101: 00010000:00010000:2.0:1789427769.587602:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427769.587616:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428400/0x84fc867ede518324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a42 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.587636:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428400/0x84fc867ede518324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a42 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.587660:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428400/0x84fc867ede518324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a42 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.587668:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428400, rc 0) 00000100:00100000:2.0:1789427769.587718:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931571584:12345-192.168.202.24@tcp:101: Request processed in 131us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.587730:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:3.0:1789427769.588792:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427769.588870:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571712 00000100:00100000:2.0:1789427769.588874:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571712 00000100:00100000:2.0:1789427769.588898:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:2.0:1789427769.588903:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931571712:12345-192.168.202.24@tcp:501: 00000100:00100000:2.0:1789427769.588999:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931571712:12345-192.168.202.24@tcp:501: Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.589006:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:0.0:1789427769.590193:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427769.590225:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571840 00000100:00100000:2.0:1789427769.590230:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571840 00000100:00100000:2.0:1789427769.590258:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 192 00000100:00100000:2.0:1789427769.590263:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931571840:12345-192.168.202.24@tcp:503: 00000100:00100000:2.0:1789427769.590330:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931571840:12345-192.168.202.24@tcp:503: Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.590334:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 192 00000100:00100000:0.0:1789427769.592543:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427769.592585:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931571968 00000100:00100000:3.0:1789427769.592617:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931571968 00000100:00100000:3.0:1789427769.592647:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:3.0:1789427769.592654:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6630:x1876350931571968:12345-192.168.202.24@tcp:502: 00000100:00100000:3.0:1789427769.592751:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6630:x1876350931571968:12345-192.168.202.24@tcp:502: Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.592766:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:2.0:1789427769.593843:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427769.593892:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572096 00000100:00100000:1.0:1789427769.593897:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572096 00000100:00100000:1.0:1789427769.593956:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:1.0:1789427769.593963:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6630:x1876350931572096:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427769.594030:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6630:x1876350931572096:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427769.594043:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:0.0:1789427769.596099:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427769.596364:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572224 00000100:00100000:2.0:1789427769.596372:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572224 00000100:00100000:2.0:1789427769.596395:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:2.0:1789427769.596400:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931572224:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427769.596438:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427769.596452:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429600/0x84fc867ede51832b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.596473:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429600/0x84fc867ede51832b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a49 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.596480:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429600/0x84fc867ede51832b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a49 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427769.596486:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429600, rc 0) 00000100:00100000:2.0:1789427769.596507:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931572224:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 107us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.596511:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:0.0:1789427769.597824:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427769.597905:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572352 00000100:00100000:1.0:1789427769.597909:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572352 00000100:00100000:1.0:1789427769.597933:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:1.0:1789427769.597939:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931572352:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427769.598036:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931572352:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 95us (210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427769.598041:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:0.0:1789427769.648850:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427769.648874:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940002432:0@lo:13: 00000100:00100000:0.0:1789427769.648940:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.649009:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002432 00000100:00100000:0.0:1789427769.649016:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002432 00000100:00100000:0.0:1789427769.649067:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427769.649084:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940002432:12345-0@lo:13: 00002000:00000024:0.0:1789427769.649112:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789427769.649658:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427769.649759:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427769.649771:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940002560:0@lo:13: 00000100:00100000:3.0:1789427769.650444:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940002944:0@lo:400: 00000100:00100000:1.0:1789427769.650486:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940003072:0@lo:400: 00000100:00100000:2.0:1789427769.650574:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.650599:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940002688:0@lo:400: 00000100:00100000:2.0:1789427769.650617:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.650629:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940003200:0@lo:400: 00000100:00100000:2.0:1789427769.650642:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.650651:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940003712:0@lo:400: 00000100:00100000:2.0:1789427769.650675:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427769.650695:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003200 00000100:00100000:2.0:1789427769.650699:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003200 00000100:00100000:0.0:1789427769.650849:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940002432:12345-0@lo:13: Request processed in 1772us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.650858:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427769.650872:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002560 00000100:00100000:0.0:1789427769.650875:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002560 00000100:00100000:0.0:1789427769.650896:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427769.650903:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940002560:12345-0@lo:13: 00002000:00000024:0.0:1789427769.650917:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427769.650947:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940002560:12345-0@lo:13: Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.650951:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427769.650964:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940002816:0@lo:400: 00000100:00100000:0.0:1789427769.650980:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.650990:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940003328:0@lo:400: 00000100:00100000:0.0:1789427769.651014:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427769.651022:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940003840:0@lo:400: 00000100:00100000:0.0:1789427769.651032:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427769.651053:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc80000 x1876350940002432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427769.651072:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940002432:0@lo:13: 00000100:00100000:0.0:1789427769.651096:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002816 00000100:00100000:0.0:1789427769.651100:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002816 00000100:00100000:0.0:1789427769.651123:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003328 00000100:00100000:0.0:1789427769.651126:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003328 00000100:00100000:0.0:1789427769.651221:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003840 00000100:00100000:0.0:1789427769.651225:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003840 00000100:00100000:0.0:1789427769.651242:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427769.651249:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940002816:12345-0@lo:400: 00000100:00100000:0.0:1789427769.651588:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940002816:12345-0@lo:400: Request processed in 338us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.651595:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427769.651607:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427769.651613:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940003328:12345-0@lo:400: 00000100:00100000:0.0:1789427769.651639:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940003328:12345-0@lo:400: Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.651644:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427769.651668:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427769.651674:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940003840:12345-0@lo:400: 00000100:00100000:0.0:1789427769.651698:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940003840:12345-0@lo:400: Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.651711:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427769.651854:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940002816:0@lo:400: 00000100:00100000:0.0:1789427769.651864:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940003328:0@lo:400: 00000100:00100000:0.0:1789427769.651871:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940003840:0@lo:400: 00010000:00080000:0.0:1789427769.651898:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcbbf480 x1876350940002560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427769.651912:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940002560:0@lo:13: 00000100:00100000:0.0:1789427769.651945:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002688 00000100:00100000:0.0:1789427769.651950:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002688 00000100:00100000:0.0:1789427769.651973:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789427769.651979:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3614:x1876350940002688:12345-0@lo:400: 00000100:00100000:0.0:1789427769.652012:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:3614:x1876350940002688:12345-0@lo:400: Request processed in 32us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.652017:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789427769.652042:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940002688:0@lo:400: 00000100:00080000:0.0:1789427769.652063:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427769.652067:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427769.652093:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003712 00000100:00100000:0.0:1789427769.652096:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003712 00000100:00100000:0.0:1789427769.652125:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427769.652132:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940003712:12345-0@lo:400: 00000100:00100000:2.0:1789427769.652435:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427769.652441:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940003200:12345-0@lo:400: 00000100:00100000:2.0:1789427769.652473:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940003200:12345-0@lo:400: Request processed in 33us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.652477:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427769.652495:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940003200:0@lo:400: 00000100:00100000:3.0:1789427769.652836:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.652860:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940003456:0@lo:400: 00000100:00100000:3.0:1789427769.652879:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.652891:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940003968:0@lo:400: 00000100:00100000:3.0:1789427769.652914:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.652940:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003456 00000100:00100000:3.0:1789427769.652943:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003456 00000100:00100000:3.0:1789427769.652966:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003968 00000100:00100000:3.0:1789427769.652969:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003968 00000100:00100000:3.0:1789427769.652986:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789427769.652993:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940003456:12345-0@lo:400: 00000100:00100000:3.0:1789427769.653024:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940003456:12345-0@lo:400: Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.653029:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789427769.653041:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427769.653047:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940003968:12345-0@lo:400: 00000100:00100000:3.0:1789427769.653072:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940003968:12345-0@lo:400: Request processed in 26us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.653089:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789427769.653119:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb69f80 x1876350940003456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427769.653129:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940003456:0@lo:400: 00000100:00100000:0.0:1789427769.653261:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940003712:12345-0@lo:400: Request processed in 1129us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.653269:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789427769.653350:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68a80 x1876350940003968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427769.653360:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940003968:0@lo:400: 00000100:00080000:0.0:1789427769.653411:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427769.653436:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427769.653492:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940002944 00000100:00100000:2.0:1789427769.653496:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940002944 00000100:00100000:2.0:1789427769.653523:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427769.653528:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940002944:12345-0@lo:400: 00000100:00100000:2.0:1789427769.653577:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940002944:12345-0@lo:400: Request processed in 49us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427769.653582:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789427769.653600:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6b800 x1876350940003712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427769.653606:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940003712:0@lo:400: 00000100:00100000:0.0:1789427769.653803:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940002944:0@lo:400: 00000100:00100000:1.0:1789427769.655178:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427769.655353:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940003584:0@lo:400: 00000100:00100000:1.0:1789427769.655375:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427769.655393:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940004096:0@lo:400: 00000100:00100000:1.0:1789427769.655405:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427769.655482:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003584 00000100:00100000:3.0:1789427769.655486:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003584 00000100:00100000:3.0:1789427769.655519:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004096 00000100:00100000:3.0:1789427769.655521:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004096 00000100:00100000:3.0:1789427769.655536:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427769.655552:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940003584:12345-0@lo:400: 00000100:00100000:3.0:1789427769.655591:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940003584:12345-0@lo:400: Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.655596:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427769.655609:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789427769.655615:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940004096:12345-0@lo:400: 00000100:00100000:3.0:1789427769.655636:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940004096:12345-0@lo:400: Request processed in 22us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427769.655640:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789427769.655731:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68700 x1876350940003584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427769.655738:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940003584:0@lo:400: 00010000:00080000:1.0:1789427769.655743:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68e00 x1876350940004096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427769.655748:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940004096:0@lo:400: 00000100:00080000:1.0:1789427769.655761:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427769.655974:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940003072 00000100:00100000:0.0:1789427769.655977:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940003072 00000100:00100000:0.0:1789427769.656025:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789427769.656030:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940003072:12345-0@lo:400: 00000100:00100000:0.0:1789427769.656069:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940003072:12345-0@lo:400: Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427769.656075:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789427769.656136:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940003072:0@lo:400: 00010000:00010000:0.0:1789427769.776606:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427770.672646:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940004224:0@lo:13: 00000100:00100000:2.0:1789427770.672731:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.672795:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004224 00000100:00100000:0.0:1789427770.672810:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004224 00000100:00100000:0.0:1789427770.672878:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427770.672891:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940004224:12345-0@lo:13: 00000100:00100000:3.0:1789427770.672918:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:0.0:1789427770.672923:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427770.672931:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940004352:0@lo:13: 00000100:00100000:3.0:1789427770.672963:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427770.673002:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789427770.673018:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940004224:12345-0@lo:13: Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.673035:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789427770.673040:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789427770.673057:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004352 00000100:00100000:0.0:1789427770.673063:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004352 00000100:00100000:0.0:1789427770.673089:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789427770.673103:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc80000 x1876350940004224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427770.673104:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940004352:12345-0@lo:13: 00000100:00100000:2.0:1789427770.673273:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940004224:0@lo:13: 00002000:00000024:0.0:1789427770.674116:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427770.674181:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940004352:12345-0@lo:13: Request processed in 1082us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.674189:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789427770.674223:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68a80 x1876350940004352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427770.674236:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940004352:0@lo:13: 10000000:01000000:0.0:1789427770.800593:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427770.800622:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bcc8a000 from 48 10000000:01000000:0.0:1789427770.800629:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427770.800685:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.800697:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.800706:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.800735:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004480:0@lo:101: 00000100:00100000:0.0:1789427770.800836:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427770.800852:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427770.800909:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.801036:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004480 00000100:00100000:2.0:1789427770.801047:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004480 00000100:00100000:2.0:1789427770.801109:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789427770.801120:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+15:6481:x1876350940004480:12345-0@lo:101: 00010000:00010000:2.0:1789427770.801149:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427770.801175:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428200/0x84fc867ede518339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518332 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.801213:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428200/0x84fc867ede518339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518332 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.801226:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428200/0x84fc867ede518339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518332 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.801237:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428200, rc 0) 00000100:00100000:2.0:1789427770.801290:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940004480:12345-0@lo:101: Request processed in 172us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.801311:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789427770.801329:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004480:0@lo:101: 00010000:00010000:0.0:1789427770.801346:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.801356:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.801470:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004608:0@lo:501: 00000100:00100000:0.0:1789427770.801507:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.801529:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.801549:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004608 00000100:00100000:3.0:1789427770.801554:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004608 00000100:00100000:3.0:1789427770.801585:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789427770.801601:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940004608:12345-0@lo:501: 00000100:00100000:0.0:1789427770.801813:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004608:0@lo:501: 00000100:00100000:3.0:1789427770.801818:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940004608:12345-0@lo:501: Request processed in 216us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.801827:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789427770.801899:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004736:0@lo:503: 00000100:00100000:0.0:1789427770.801932:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.801949:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.801974:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004736 00000100:00100000:2.0:1789427770.801979:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004736 00000100:00100000:2.0:1789427770.802005:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789427770.802013:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940004736:12345-0@lo:503: 00000100:00100000:2.0:1789427770.802098:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940004736:12345-0@lo:503: Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.802106:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789427770.802149:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940004736:0@lo:503: 00000100:00100000:0.0:1789427770.802529:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10315:1876350940004864:0@lo:502: 00000100:00100000:0.0:1789427770.802557:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.802592:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.802596:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004864 00000100:00100000:3.0:1789427770.802602:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004864 00000100:00100000:3.0:1789427770.802632:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789427770.802641:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:10315:x1876350940004864:12345-0@lo:502: 00000100:00100000:3.0:1789427770.802719:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:10315:x1876350940004864:12345-0@lo:502: Request processed in 80us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.802727:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789427770.802749:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10315:1876350940004864:0@lo:502: 00000100:00100000:0.0:1789427770.802780:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10315:1876350940004992:0@lo:502: 00000100:00100000:0.0:1789427770.802802:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.802828:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.802845:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940004992 00000100:00100000:2.0:1789427770.802850:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940004992 00000100:00100000:2.0:1789427770.802871:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789427770.802885:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:10315:x1876350940004992:12345-0@lo:502: 00000100:00100000:2.0:1789427770.802946:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:10315:x1876350940004992:12345-0@lo:502: Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.802953:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789427770.802960:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10315:1876350940004992:0@lo:502: 00000040:00080000:0.0:1789427770.802977:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789427770.803062:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789427770.803083:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789427770.803093:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.803104:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427770.803112:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789427770.803115:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789427770.803118:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789427770.803154:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.803162:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.803170:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427770.803187:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005120:0@lo:101: 00000100:00100000:3.0:1789427770.803212:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.803229:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.803236:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005120 00000100:00100000:0.0:1789427770.803241:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005120 00000100:00100000:0.0:1789427770.803273:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789427770.803279:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+16:6481:x1876350940005120:12345-0@lo:101: 00010000:00010000:0.0:1789427770.803287:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427770.803368:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209400/0x84fc867ede518347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518340 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.803387:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209400/0x84fc867ede518347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518340 expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.803397:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209400/0x84fc867ede518347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518340 expref: 17 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.803405:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209400, rc 0) 00000100:00100000:0.0:1789427770.803475:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005120:12345-0@lo:101: Request processed in 195us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.803490:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789427770.803518:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005120:0@lo:101: 00010000:00010000:3.0:1789427770.803530:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.803538:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427770.803581:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005248:0@lo:501: 00000100:00100000:3.0:1789427770.803605:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.803629:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.803643:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005248 00000100:00100000:2.0:1789427770.803649:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005248 00000100:00100000:2.0:1789427770.803676:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789427770.803689:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005248:12345-0@lo:501: 00000100:00100000:2.0:1789427770.803763:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005248:12345-0@lo:501: Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.803770:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789427770.803793:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005248:0@lo:501: 00000100:00100000:3.0:1789427770.803814:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005376:0@lo:503: 00000100:00100000:3.0:1789427770.803839:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.803851:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.803856:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005376 00000100:00100000:0.0:1789427770.803860:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005376 00000100:00100000:0.0:1789427770.803884:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789427770.803891:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005376:12345-0@lo:503: 00000100:00100000:0.0:1789427770.803954:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005376:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.803959:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789427770.803984:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005376:0@lo:503: 00000100:00100000:3.0:1789427770.804161:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10316:1876350940005504:0@lo:502: 00000100:00100000:3.0:1789427770.804185:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.804199:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.804223:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005504 00000100:00100000:2.0:1789427770.804228:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005504 00000100:00100000:2.0:1789427770.804250:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789427770.804256:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:10316:x1876350940005504:12345-0@lo:502: 00000100:00100000:2.0:1789427770.804328:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:10316:x1876350940005504:12345-0@lo:502: Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.804334:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789427770.804534:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10316:1876350940005504:0@lo:502: 00000020:01000000:3.0:1789427770.804551:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427770.804566:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427770.804574:0:10316:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789427770.804579:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789427770.804601:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10316:1876350940005632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.804640:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.804669:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005632 00000100:00100000:0.0:1789427770.804674:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005632 00000100:00100000:3.0:1789427770.804677:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fdaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.804703:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789427770.804710:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:10316:x1876350940005632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427770.804767:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:10316:x1876350940005632:12345-0@lo:502:llog_process_th.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.804772:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789427770.804800:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10316:1876350940005632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789427770.804814:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427770.804824:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427770.804827:0:10316:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789427770.804830:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789427770.804877:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789427770.804891:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789427770.804896:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.804903:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.804909:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427770.804911:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bc9e1800 from 48 10000000:01000000:0.0:1789427770.804913:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427770.804926:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.804936:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.804941:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.804950:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.804968:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.804984:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.805009:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005760 00000100:00100000:2.0:1789427770.805013:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005760 00000100:00100000:2.0:1789427770.805034:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789427770.805040:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+17:6481:x1876350940005760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427770.805047:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427770.805055:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428a00/0x84fc867ede518355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51834e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.805070:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428a00/0x84fc867ede518355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51834e expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.805079:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428a00/0x84fc867ede518355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51834e expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.805087:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428a00, rc 0) 00000100:00100000:2.0:1789427770.805113:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940005760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.805122:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.805138:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00010000:0.0:1789427770.805150:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.805159:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.805195:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.805211:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.805224:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.805240:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940005888 00000100:00100000:3.0:1789427770.805245:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940005888 00000100:00100000:0.0:1789427770.805278:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789427770.805288:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940005888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.805364:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940005888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.805371:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789427770.805411:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940005888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.805471:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.805519:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.805545:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.805565:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006016 00000100:00100000:2.0:1789427770.805569:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006016 00000100:00100000:2.0:1789427770.805605:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789427770.805612:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940006016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.805676:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940006016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.805682:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789427770.805697:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.805928:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10317:1876350940006144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.805952:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.805964:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.805972:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006144 00000100:00100000:0.0:1789427770.805977:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006144 00000100:00100000:0.0:1789427770.806004:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789427770.806010:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:10317:x1876350940006144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427770.806086:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:10317:x1876350940006144:12345-0@lo:502:llog_process_th.0 Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.806092:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10317:1876350940006144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427770.806097:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789427770.806142:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10317:1876350940006272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.806168:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.806179:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.806189:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006272 00000100:00100000:0.0:1789427770.806194:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006272 00000100:00100000:0.0:1789427770.806217:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789427770.806223:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:10317:x1876350940006272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427770.806291:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:10317:x1876350940006272:12345-0@lo:502:llog_process_th.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.806299:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789427770.806305:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10317:1876350940006272:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789427770.806328:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789427770.806371:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789427770.806392:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427770.806400:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.806411:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.806437:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789427770.806439:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789427770.806442:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427770.806456:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.806473:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.806482:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.806494:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.806517:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.806538:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.806556:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006400 00000100:00100000:2.0:1789427770.806561:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006400 00000100:00100000:2.0:1789427770.806585:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789427770.806599:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+18:6481:x1876350940006400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427770.806606:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427770.806615:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429c00/0x84fc867ede518363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51835c expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.806631:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429c00/0x84fc867ede518363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51835c expref: 19 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.806640:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429c00/0x84fc867ede518363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51835c expref: 19 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.806648:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429c00, rc 0) 00000100:00100000:2.0:1789427770.806677:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940006400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.806682:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789427770.806702:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.806713:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.806721:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.806754:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.806775:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.806792:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.806813:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006528 00000100:00100000:3.0:1789427770.806830:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006528 00000100:00100000:3.0:1789427770.806858:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789427770.806864:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940006528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.806933:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940006528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.806938:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789427770.806946:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.806968:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.806997:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.807012:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.807028:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006656 00000100:00100000:2.0:1789427770.807039:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006656 00000100:00100000:2.0:1789427770.807058:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789427770.807063:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940006656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.807144:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940006656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.807151:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.807152:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789427770.807346:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10318:1876350940006784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.807370:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427770.807385:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.807405:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006784 00000100:00100000:3.0:1789427770.807409:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006784 00000100:00100000:3.0:1789427770.807446:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789427770.807452:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:10318:x1876350940006784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.807505:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:10318:x1876350940006784:12345-0@lo:502:llog_process_th.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.807512:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789427770.807527:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10318:1876350940006784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427770.807545:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427770.807551:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427770.807553:0:10318:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789427770.807559:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789427770.807574:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10318:1876350940006912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.807599:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427770.807621:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427770.807628:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940006912 00000100:00100000:0.0:1789427770.807638:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940006912 00000100:00100000:0.0:1789427770.807667:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789427770.807673:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:10318:x1876350940006912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427770.807734:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:10318:x1876350940006912:12345-0@lo:502:llog_process_th.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.807742:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789427770.807752:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10318:1876350940006912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427770.807768:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427770.807771:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427770.807772:0:10318:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789427770.807774:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789427770.807815:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789427770.807829:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789427770.807835:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.807844:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.807852:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427770.807855:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196adadd000 from 48 10000000:01000000:0.0:1789427770.807857:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427770.807870:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.807878:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.807886:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.807898:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.807922:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.807938:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.807960:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007040 00000100:00100000:3.0:1789427770.807966:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007040 00000100:00100000:3.0:1789427770.807991:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789427770.807999:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:6481:x1876350940007040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427770.808006:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427770.808016:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883b200/0x84fc867ede518371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51836a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.808030:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883b200/0x84fc867ede518371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51836a expref: 20 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.808039:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883b200/0x84fc867ede518371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51836a expref: 20 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.808058:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b200, rc 0) 00000100:00100000:3.0:1789427770.808091:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.808098:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789427770.808101:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.808115:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.808123:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.808167:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.808187:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.808203:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.808238:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007168 00000100:00100000:1.0:1789427770.808243:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007168 00000100:00100000:1.0:1789427770.808267:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789427770.808275:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427770.808345:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.808352:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427770.808357:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789427770.808376:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.808405:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.808452:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.808462:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007296 00000100:00100000:3.0:1789427770.808468:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007296 00000100:00100000:3.0:1789427770.808493:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789427770.808501:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.808566:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.808572:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.808576:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789427770.808870:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10319:1876350940007424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.808903:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427770.808957:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.808985:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007424 00000100:00100000:1.0:1789427770.808989:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007424 00000100:00100000:1.0:1789427770.809011:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789427770.809018:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:10319:x1876350940007424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.809096:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:10319:x1876350940007424:12345-0@lo:502:llog_process_th.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.809103:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789427770.809151:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10319:1876350940007424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.809198:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10319:1876350940007552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.809230:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427770.809248:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698cb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.809265:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007552 00000100:00100000:3.0:1789427770.809269:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007552 00000100:00100000:3.0:1789427770.809297:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789427770.809303:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:10319:x1876350940007552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.809363:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:10319:x1876350940007552:12345-0@lo:502:llog_process_th.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.809369:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789427770.809390:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10319:1876350940007552:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789427770.809411:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789427770.809540:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789427770.809555:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789427770.809562:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.809571:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427770.809589:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789427770.809592:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789427770.809594:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789427770.809610:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.809618:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.809625:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427770.809639:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.809663:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.809693:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.809998:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007680 00000100:00100000:1.0:1789427770.810004:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007680 00000100:00100000:1.0:1789427770.810033:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789427770.810041:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940007680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427770.810048:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427770.810059:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813eda00/0x84fc867ede51837f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518378 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.810079:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813eda00/0x84fc867ede51837f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518378 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.810088:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813eda00/0x84fc867ede51837f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518378 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.810103:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813eda00, rc 0) 00000100:00100000:1.0:1789427770.810157:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940007680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.810318:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789427770.810391:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.810403:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.810453:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.810512:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.810543:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.810566:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.810625:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007808 00000100:00100000:1.0:1789427770.810630:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007808 00000100:00100000:1.0:1789427770.810662:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789427770.810670:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940007808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427770.810774:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940007808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.810781:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789427770.810865:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.810892:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.810926:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.810980:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.811003:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940007936 00000100:00100000:1.0:1789427770.811006:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940007936 00000100:00100000:1.0:1789427770.811026:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789427770.811036:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940007936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427770.811108:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940007936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.811115:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789427770.811116:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940007936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.811559:0:10320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10320:1876350940008064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.811594:0:10320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.811625:0:10320:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b4886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.811646:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008064 00000100:00100000:1.0:1789427770.811651:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008064 00000100:00100000:1.0:1789427770.811679:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789427770.811688:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10320:x1876350940008064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.811769:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10320:x1876350940008064:12345-0@lo:502:llog_process_th.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.811777:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789427770.811789:0:10320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10320:1876350940008064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789427770.811816:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427770.811825:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427770.811828:0:10320:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789427770.811833:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789427770.811853:0:10320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10320:1876350940008192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.811885:0:10320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.811901:0:10320:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b4886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.811922:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008192 00000100:00100000:1.0:1789427770.811927:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008192 00000100:00100000:1.0:1789427770.811949:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789427770.811955:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10320:x1876350940008192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.812016:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10320:x1876350940008192:12345-0@lo:502:llog_process_th.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.812023:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789427770.812068:0:10320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10320:1876350940008192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789427770.812092:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427770.812097:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427770.812099:0:10320:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789427770.812103:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789427770.812239:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789427770.812261:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789427770.812271:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.812284:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.812295:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427770.812298:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919684ed8800 from 48 10000000:01000000:0.0:1789427770.812301:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427770.812322:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.812330:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.812339:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.812352:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.812385:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.812405:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.812477:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008320 00000100:00100000:1.0:1789427770.812481:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008320 00000100:00100000:1.0:1789427770.812679:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789427770.812687:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940008320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427770.812695:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427770.812707:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813edc00/0x84fc867ede51838d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518386 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.812727:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813edc00/0x84fc867ede51838d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518386 expref: 22 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.812737:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813edc00/0x84fc867ede51838d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518386 expref: 22 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427770.812746:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813edc00, rc 0) 00000100:00100000:1.0:1789427770.812779:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.812785:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789427770.812831:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.812841:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.812851:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.812896:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.812919:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.813008:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.813282:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008448 00000100:00100000:2.0:1789427770.813287:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008448 00000100:00100000:2.0:1789427770.813308:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789427770.813314:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.814438:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1098us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.814447:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789427770.814610:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.814691:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.814730:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.814786:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427770.814811:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008576 00000100:00100000:1.0:1789427770.814815:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008576 00000100:00100000:1.0:1789427770.814841:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789427770.814849:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427770.814960:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.814967:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789427770.815018:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.815320:0:10321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10321:1876350940008704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.815350:0:10321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427770.815364:0:10321:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488840 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.815383:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008704 00000100:00100000:2.0:1789427770.815388:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008704 00000100:00100000:2.0:1789427770.815433:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789427770.815439:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10321:x1876350940008704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427770.815557:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10321:x1876350940008704:12345-0@lo:502:llog_process_th.0 Request processed in 117us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.815564:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789427770.815758:0:10321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10321:1876350940008704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.815792:0:10321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10321:1876350940008832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.815821:0:10321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427770.815843:0:10321:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.815868:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008832 00000100:00100000:3.0:1789427770.815874:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008832 00000100:00100000:3.0:1789427770.815904:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789427770.815913:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10321:x1876350940008832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.815984:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10321:x1876350940008832:12345-0@lo:502:llog_process_th.0 Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.815995:0:10321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10321:1876350940008832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.816006:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000040:00080000:1.0:1789427770.816017:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789427770.816188:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789427770.816212:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427770.816221:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.816233:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.816241:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789427770.816243:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789427770.816245:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427770.816266:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.816280:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.816290:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.816304:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.816334:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.816350:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.816374:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940008960 00000100:00100000:2.0:1789427770.816378:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940008960 00000100:00100000:2.0:1789427770.816403:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789427770.816409:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940008960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427770.816495:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427770.816506:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428800/0x84fc867ede51839b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518394 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.816533:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428800/0x84fc867ede51839b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518394 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.816544:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428800/0x84fc867ede51839b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518394 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427770.816552:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428800, rc 0) 00000100:00100000:2.0:1789427770.816587:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940008960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.816594:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789427770.816688:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940008960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.816699:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.816708:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.816751:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.816772:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.816795:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.816814:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009088 00000100:00100000:3.0:1789427770.816820:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009088 00000100:00100000:3.0:1789427770.816845:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789427770.816852:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940009088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.816940:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940009088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.816947:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789427770.816968:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.816992:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.817022:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.817038:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427770.817309:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009216 00000100:00100000:2.0:1789427770.817314:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009216 00000100:00100000:2.0:1789427770.817387:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789427770.817395:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940009216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.817679:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427770.817690:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940009216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427770.817699:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789427770.818076:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10322:1876350940009344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.818121:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427770.818155:0:10322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.818178:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009344 00000100:00100000:3.0:1789427770.818183:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009344 00000100:00100000:3.0:1789427770.818221:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789427770.818235:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10322:x1876350940009344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.818321:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10322:x1876350940009344:12345-0@lo:502:llog_process_th.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.818338:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789427770.818348:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10322:1876350940009344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427770.818375:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427770.818389:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427770.818391:0:10322:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789427770.818399:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789427770.818449:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10322:1876350940009472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427770.818485:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427770.818504:0:10322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.818519:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009472 00000100:00100000:3.0:1789427770.818525:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009472 00000100:00100000:3.0:1789427770.818555:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789427770.818564:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10322:x1876350940009472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427770.818640:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10322:x1876350940009472:12345-0@lo:502:llog_process_th.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.818647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789427770.818716:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10322:1876350940009472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427770.818735:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427770.818739:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427770.818741:0:10322:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789427770.818749:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789427770.818864:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789427770.818887:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789427770.818896:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.818907:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427770.818916:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789427770.818918:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688454d40 from 1 10000000:01000000:0.0:1789427770.818921:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789427770.818939:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.818947:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.818955:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.818969:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.818996:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.819025:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.819074:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009600 00000100:00100000:3.0:1789427770.819079:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009600 00000100:00100000:3.0:1789427770.819107:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789427770.819114:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940009600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427770.819122:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427770.819150:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883ae00/0x84fc867ede5183a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5183a2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.819169:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883ae00/0x84fc867ede5183a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5183a2 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.819180:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883ae00/0x84fc867ede5183a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183a2 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427770.819189:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ae00, rc 0) 00000100:00100000:3.0:1789427770.819219:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940009600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.819226:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789427770.819291:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427770.819302:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.819311:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427770.819353:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427770.819385:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427770.819406:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427770.819604:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009728 00000100:00100000:3.0:1789427770.819614:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009728 00000100:00100000:3.0:1789427770.819677:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789427770.819685:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940009728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427770.819749:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940009728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789427770.819756:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789427770.819802:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940009728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789427770.819820:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789427770.819825:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427770.819833:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789427771.290621:0:10359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebeac8f40 20000000:00000080:3.0:1789427771.290642:0:10359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196bcc94400 uarg=0000000000000000 20000000:01000000:3.0:1789427771.290687:0:10359:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427771.290693:0:10359:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427771.290698:0:10359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789427771.291616:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789427771.291779:0:10359:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789427771.295220:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789427771.295257:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789427771.295275:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789427771.295291:0:10359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427771.295309:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295326:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295334:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295340:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295348:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5181cd expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295373:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 9 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295382:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295788:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 9 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295806:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 9 pid: 6475 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427771.295823:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940009856:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427771.295930:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.295939:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 23 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427771.295947:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940009984:0@lo:104: 00000100:00100000:3.0:1789427771.295988:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427771.296018:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296025:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 23 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427771.296033:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010112:0@lo:104: 00000100:00100000:3.0:1789427771.296068:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427771.296097:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940009984 00000100:00100000:3.0:1789427771.296104:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940009984 00000100:00100000:3.0:1789427771.296152:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010112 00000100:00100000:3.0:1789427771.296155:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010112 00000100:00100000:3.0:1789427771.296170:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427771.296178:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:10359:x1876350940009984:12345-0@lo:104: 00010000:00010000:3.0:1789427771.296191:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296237:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427771.296242:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:10359:x1876350940009984:12345-0@lo:104: Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427771.296249:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427771.296265:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789427771.296271:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196aebd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010112:12345-0@lo:104: 00010000:00010000:3.0:1789427771.296278:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296310:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789427771.296315:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196aebd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010112:12345-0@lo:104: Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427771.296321:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789427771.296369:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296378:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427771.296397:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010240:0@lo:104: 00000100:00100000:3.0:1789427771.296442:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427771.296461:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010240 00000100:00100000:3.0:1789427771.296464:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010240 00000100:00100000:3.0:1789427771.296487:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789427771.296491:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010240:12345-0@lo:104: 00010000:00010000:3.0:1789427771.296498:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296527:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789427771.296532:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010240:12345-0@lo:104: Request processed in 41us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427771.296536:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789427771.296561:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296569:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 23 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427771.296577:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010368:0@lo:104: 00000100:00100000:3.0:1789427771.296597:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427771.296614:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010368 00000100:00100000:3.0:1789427771.296618:0:6467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010368 00000100:00100000:3.0:1789427771.296637:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789427771.296642:0:6467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010368:12345-0@lo:104: 00010000:00010000:3.0:1789427771.296650:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427771.296688:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789427771.296693:0:6467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:10359:x1876350940010368:12345-0@lo:104: Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427771.296699:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789427771.296721:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427771.296740:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940009984:0@lo:104: 00000100:00100000:3.0:1789427771.296749:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010112:0@lo:104: 00000100:00100000:3.0:1789427771.296755:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010240:0@lo:104: 00000100:00100000:3.0:1789427771.296760:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940010368:0@lo:104: 00010000:00010000:0.0:1789427771.296917:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789427771.296924:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.296931:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427771.296935:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.296944:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427771.296950:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427771.296956:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427771.296990:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297011:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427771.297036:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297043:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196c21e9e00/0x84fc867ede5181cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5181d4 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297057:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427771.297061:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297067:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427771.297070:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297077:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427771.297084:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427771.297089:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427771.297103:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297108:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427771.297137:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297143:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208000/0x84fc867ede5180a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5180ae expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297158:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427771.297161:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297167:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427771.297170:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297177:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427771.297184:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427771.297189:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427771.297206:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297212:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427771.297220:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297226:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede518045 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51804c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297236:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427771.297239:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297256:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427771.297259:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297267:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427771.297273:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427771.297277:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427771.297290:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297295:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427771.297301:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297308:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec000/0x84fc867ede517ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede517ff8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297321:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427771.297323:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427771.297325:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427771.297339:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940010496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.297371:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427771.297402:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427771.297409:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940010880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.297474:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427771.297510:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940010752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.297534:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427771.297553:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427771.297559:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940010624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.297582:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427771.297605:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010496 00000100:00100000:0.0:1789427771.297609:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010496 00010000:00010000:0.0:1789427771.297630:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 24 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.297648:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010880 00000100:00100000:0.0:1789427771.297651:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010880 00010000:00010000:0.0:1789427771.297661:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 25 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.297669:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010752 00000100:00100000:0.0:1789427771.297671:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010752 00010000:00010000:0.0:1789427771.297679:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 26 pid: 6478 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.297687:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940010624 00000100:00100000:0.0:1789427771.297689:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940010624 00010000:00010000:0.0:1789427771.297696:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 27 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.297706:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427771.297711:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+27:3616:x1876350940010496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427771.297721:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427771.297725:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 27 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297739:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 27 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297751:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208400/0x84fc867ede5181d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5181cd expref: 27 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297761:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427771.297788:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+26:3616:x1876350940010496:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427771.297794:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427771.297808:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427771.297813:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3616:x1876350940010880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427771.297821:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427771.297825:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 25 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297832:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 25 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297840:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9a00/0x84fc867ede517ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede517ff1 expref: 25 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297848:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427771.297866:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940010880:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427771.297871:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427771.297882:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427771.297887:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3614:x1876350940010752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427771.297900:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427771.297905:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297911:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297920:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965600/0x84fc867ede51804c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518045 expref: 23 pid: 6478 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297929:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427771.297953:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3614:x1876350940010752:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427771.297958:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427771.297970:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427771.297975:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688831050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3614:x1876350940010624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427771.297982:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427771.297986:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 21 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.297993:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 21 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.298017:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965800/0x84fc867ede5180ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5180a7 expref: 21 pid: 6477 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.298025:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427771.298045:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688831050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3614:x1876350940010624:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427771.298058:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427771.298116:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940010624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.298136:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940010752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.298160:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940010880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427771.298166:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940010496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427771.298241:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427771.298764:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427771.298994:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427771.301295:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427771.301408:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1876350940009856:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427771.301515:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427771.301663:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572480 00000100:00100000:1.0:1789427771.301671:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572480 00010000:00010000:0.0:1789427771.301760:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.301800:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:0.0:1789427771.301809:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2397:x1876350931572480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427771.301823:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427771.301829:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301840:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301857:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919680031000/0x84fc867ede5182ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a0a expref: 10 pid: 6475 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301871:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301894:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301910:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301917:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301923:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301929:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301935:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427771.301939:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301947:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301956:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427771.301966:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427771.302021:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2397:x1876350931572480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 212us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427771.302028:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00010000:00010000:2.0:1789427771.302211:0:10359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427771.302219:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427771.302226:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883be00/0x84fc867ede5183b0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427771.697829:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940011008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427771.697940:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.698050:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011008 00000100:00100000:2.0:1789427771.698079:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011008 00000100:00100000:2.0:1789427771.698159:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789427771.698170:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940011008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427771.698222:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427771.698612:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940011008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 443us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.698621:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427771.698733:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940011008:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427771.824549:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789427772.528498:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427772.528510:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8a000 from 4 10000000:01000000:3.0:1789427772.528517:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427772.528576:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427772.528590:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427772.528604:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427772.528637:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427772.528731:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427772.528823:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427772.529034:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011136 00000100:00100000:0.0:1789427772.529043:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011136 00000100:00100000:0.0:1789427772.529318:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789427772.529332:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940011136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427772.529360:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427772.529378:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5183b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427772.529408:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427772.529436:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427772.529447:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208800, rc 0) 00000100:00100000:0.0:1789427772.529501:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427772.529508:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789427772.529607:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427772.529627:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.529638:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427772.529833:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.529864:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.529892:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427772.530020:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011264 00000100:00100000:3.0:1789427772.530026:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011264 00000100:00100000:3.0:1789427772.530086:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789427772.530103:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427772.530256:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427772.530264:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789427772.530287:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.530318:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.530361:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.530580:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011392 00000100:00100000:1.0:1789427772.530585:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011392 00000100:00100000:2.0:1789427772.530589:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581d4c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.530612:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789427772.530623:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.530734:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427772.530753:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.530753:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789427772.531083:0:10440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10440:1876350940011520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.531194:0:10440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.531251:0:10440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdac240 going to sleep for 11 seconds 00000100:00100000:3.0:1789427772.531282:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011520 00000100:00100000:3.0:1789427772.531286:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011520 00000100:00100000:3.0:1789427772.531338:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789427772.531345:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10440:x1876350940011520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427772.531603:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10440:x1876350940011520:12345-0@lo:502:llog_process_th.0 Request processed in 258us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427772.531611:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789427772.531684:0:10440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10440:1876350940011520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427772.531708:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427772.531718:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427772.531722:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789427772.531731:0:10440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bcc8a000 00000020:00000080:2.0:1789427772.531734:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789427772.531861:0:10440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10440:1876350940011648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427772.531894:0:10440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.531914:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011648 00000100:00100000:2.0:1789427772.531918:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011648 00000100:00100000:2.0:1789427772.531942:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789427772.531949:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10440:x1876350940011648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427772.532018:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:10440:x1876350940011648:12345-0@lo:502:llog_process_th.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.532025:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789427772.532057:0:10440:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.532068:0:10440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10440:1876350940011648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427772.532086:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427772.532195:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427772.532197:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789427772.532202:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789427772.532324:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789427772.532343:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427772.532353:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532388:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427772.532400:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427772.532404:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bc9e1800 from 4 10000000:01000000:2.0:1789427772.532407:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427772.532450:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532458:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532467:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427772.532481:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.532509:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.532525:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.532542:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011776 00000100:00100000:2.0:1789427772.532546:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011776 00000100:00100000:2.0:1789427772.532567:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789427772.532573:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940011776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427772.532581:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427772.532594:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5183c5 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532616:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 22 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532639:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 22 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532648:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789427772.532678:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940011776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.532685:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789427772.532718:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427772.532730:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.532740:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427772.532784:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.532807:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.532820:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.532831:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940011904 00000100:00100000:2.0:1789427772.532834:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940011904 00000100:00100000:2.0:1789427772.532854:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789427772.532860:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940011904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.532942:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940011904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.532949:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789427772.533155:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.533187:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.533219:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.533233:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.533245:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012032 00000100:00100000:2.0:1789427772.533249:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012032 00000100:00100000:2.0:1789427772.533268:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789427772.533274:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940012032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.533329:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940012032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.533336:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789427772.533444:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427772.533838:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10441:1876350940012160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427772.533877:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.533912:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.534170:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012160 00000100:00100000:1.0:1789427772.534175:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012160 00000100:00100000:1.0:1789427772.534199:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789427772.534205:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10441:x1876350940012160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.534283:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10441:x1876350940012160:12345-0@lo:502:llog_process_th.0 Request processed in 78us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.534290:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789427772.534554:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10441:1876350940012160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427772.534574:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427772.534583:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427772.534585:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789427772.534593:0:10441:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bc9e1800 00000020:00000080:2.0:1789427772.534596:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789427772.534665:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10441:1876350940012288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427772.534695:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427772.534753:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.535129:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012288 00000100:00100000:1.0:1789427772.535134:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012288 00000100:00100000:1.0:1789427772.535198:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789427772.535205:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10441:x1876350940012288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.535276:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:10441:x1876350940012288:12345-0@lo:502:llog_process_th.0 Request processed in 71us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.535283:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789427772.535342:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10441:1876350940012288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427772.535360:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427772.535368:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427772.535370:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789427772.535374:0:10441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789427772.535531:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789427772.535552:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427772.535562:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.535584:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427772.535596:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427772.535599:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196adadd000 from 4 10000000:01000000:1.0:1789427772.535601:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427772.535625:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.535633:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.535642:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427772.535656:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.535684:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.535741:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdaca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427772.535772:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012416 00000100:00100000:2.0:1789427772.535777:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012416 00000100:00100000:2.0:1789427772.535835:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789427772.535843:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940012416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427772.535853:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427772.535868:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5183d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.535889:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.535900:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427772.535909:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429200, rc 0) 00000100:00100000:2.0:1789427772.535935:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940012416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.535942:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789427772.535990:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427772.536002:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.536011:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427772.536072:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536098:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.536129:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdaca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.536140:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012544 00000100:00100000:1.0:1789427772.536144:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012544 00000100:00100000:1.0:1789427772.536165:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789427772.536170:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940012544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536265:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940012544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.536272:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789427772.536302:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536329:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536359:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.536371:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdaca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.536382:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012672 00000100:00100000:1.0:1789427772.536385:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012672 00000100:00100000:1.0:1789427772.536403:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789427772.536409:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940012672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536495:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940012672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.536501:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789427772.536536:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940012672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.536720:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10443:1876350940012800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.536755:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.536774:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012800 00000100:00100000:1.0:1789427772.536778:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012800 00000100:00100000:1.0:1789427772.536798:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789427772.536804:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10443:x1876350940012800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.536869:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10443:x1876350940012800:12345-0@lo:502:llog_process_th.0 Request processed in 65us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.536876:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789427772.536907:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.536919:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10443:1876350940012800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427772.536938:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427772.536945:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427772.536947:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789427772.536955:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196adadd000 00000020:00000080:1.0:1789427772.536957:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427772.537021:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10443:1876350940012928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.537050:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.537068:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940012928 00000100:00100000:1.0:1789427772.537072:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940012928 00000100:00100000:1.0:1789427772.537091:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789427772.537097:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10443:x1876350940012928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.537173:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:10443:x1876350940012928:12345-0@lo:502:llog_process_th.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.537180:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789427772.537208:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.537218:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10443:1876350940012928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427772.537234:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427772.537238:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427772.537240:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789427772.537243:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789427772.537280:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789427772.537302:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427772.537309:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537319:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427772.537328:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427772.537331:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919684ed8800 from 4 10000000:01000000:1.0:1789427772.537334:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427772.537351:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537359:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537367:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427772.537379:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.537402:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.537447:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.537471:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013056 00000100:00100000:1.0:1789427772.537475:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013056 00000100:00100000:1.0:1789427772.537494:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789427772.537499:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940013056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427772.537507:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427772.537518:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5183e1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537547:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537556:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537564:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec000, rc 0) 00000100:00100000:1.0:1789427772.537593:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940013056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.537599:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789427772.537632:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427772.537644:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.537653:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427772.537694:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.537715:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.537734:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.537745:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013184 00000100:00100000:1.0:1789427772.537749:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013184 00000100:00100000:1.0:1789427772.537767:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789427772.537773:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940013184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.537845:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940013184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.537861:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789427772.537889:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.537915:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.537945:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.537957:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.537967:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013312 00000100:00100000:1.0:1789427772.537971:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013312 00000100:00100000:1.0:1789427772.537990:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789427772.537995:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940013312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.538056:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940013312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.538063:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789427772.538097:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940013312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427772.538326:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10444:1876350940013440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.538358:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.538375:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013440 00000100:00100000:1.0:1789427772.538379:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013440 00000100:00100000:1.0:1789427772.538399:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789427772.538405:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:10444:x1876350940013440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.538629:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:10444:x1876350940013440:12345-0@lo:502:llog_process_th.0 Request processed in 223us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.538637:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789427772.538678:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.538690:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10444:1876350940013440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427772.538715:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427772.538724:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427772.538726:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789427772.538733:0:10444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919684ed8800 00000020:00000080:1.0:1789427772.538736:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427772.538806:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10444:1876350940013568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.538840:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427772.538860:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013568 00000100:00100000:1.0:1789427772.538864:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013568 00000100:00100000:1.0:1789427772.538884:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789427772.538890:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:10444:x1876350940013568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427772.538944:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:10444:x1876350940013568:12345-0@lo:502:llog_process_th.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.538950:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789427772.538978:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adbb13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427772.538989:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:10444:1876350940013568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427772.539005:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427772.539009:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427772.539010:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789427772.539014:0:10444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789427772.539059:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789427772.539074:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427772.539081:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.539092:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427772.849410:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427772.906525:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427772.906612:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427772.906661:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427772.906698:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427772.906759:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572992 00000100:00100000:1.0:1789427772.906772:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572992 00000100:00100000:1.0:1789427772.906852:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1789427772.906865:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931572992:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427772.906955:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931572992:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.906963:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00080000:1.0:1789427772.906990:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427772.907187:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572608 00000100:00100000:2.0:1789427772.907192:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572608 00000100:00100000:2.0:1789427772.907232:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 260 00000100:00100000:2.0:1789427772.907240:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2396:x1876350931572608:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427772.907275:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2396:x1876350931572608:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427772.907282:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 260 00000100:00100000:0.0:1789427772.907590:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427772.907661:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573120 00000100:00100000:1.0:1789427772.907665:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573120 00000100:00100000:1.0:1789427772.907707:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1789427772.907714:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931573120:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427772.907746:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931573120:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.907753:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00080000:0.0:1789427772.907861:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427772.908258:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572736 00000100:00100000:3.0:1789427772.908264:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572736 00000100:00100000:3.0:1789427772.908404:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931572864 00000100:00100000:3.0:1789427772.908408:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931572864 00000100:00100000:1.0:1789427772.908570:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:1.0:1789427772.908580:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931572736:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427772.908620:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931572736:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 42us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427772.908627:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00080000:0.0:1789427772.909028:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427772.909032:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427772.909327:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1789427772.909336:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931572864:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427772.909384:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931572864:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 51us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427772.909392:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:1.0:1789427773.027302:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427773.028847:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573248 00000100:00100000:2.0:1789427773.028871:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573248 00000100:00100000:2.0:1789427773.028973:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 261 00000100:00100000:2.0:1789427773.028984:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:6156:x1876350931573248:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427773.029000:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427773.029017:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a50 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427773.029045:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427773.029056:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427773.029064:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429000, rc 0) 00000100:00100000:2.0:1789427773.029209:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931573248:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 226us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427773.029216:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 261 00000100:00100000:2.0:1789427773.035932:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427773.036034:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573376 00000100:00100000:1.0:1789427773.036044:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573376 00000100:00100000:1.0:1789427773.036157:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 262 00000100:00100000:1.0:1789427773.036167:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931573376:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427773.036304:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931573376:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427773.036312:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 262 00000100:00100000:3.0:1789427773.037925:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427773.040633:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573504 00000100:00100000:2.0:1789427773.040646:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573504 00000100:00100000:2.0:1789427773.040698:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 263 00000100:00100000:2.0:1789427773.040709:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931573504:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427773.040864:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6156:x1876350931573504:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 156us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427773.040873:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 263 00000100:00100000:3.0:1789427773.053922:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427773.054051:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573632 00000100:00100000:2.0:1789427773.054065:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573632 00000100:00100000:2.0:1789427773.054163:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 264 00000100:00100000:2.0:1789427773.054174:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6802:x1876350931573632:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427773.054324:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6802:x1876350931573632:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 151us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427773.054332:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 264 00000100:00100000:3.0:1789427773.055663:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427773.055743:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573760 00000100:00100000:1.0:1789427773.055816:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573760 00000100:00100000:1.0:1789427773.055870:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 265 00000100:00100000:1.0:1789427773.055886:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6802:x1876350931573760:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427773.056024:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:6802:x1876350931573760:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427773.056032:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 265 00010000:00010000:0.0:1789427773.877348:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427774.261242:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940013696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427774.261334:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427774.261457:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013696 00000100:00100000:1.0:1789427774.261468:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013696 00000100:00100000:1.0:1789427774.261536:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427774.261548:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940013696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427774.261592:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427774.261651:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940013696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427774.261660:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427774.261720:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940013696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427774.768606:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940013824:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.768716:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.768727:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940013952:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.768772:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.768793:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940014336:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.768802:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940014464:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.768841:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.768841:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.768876:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940014848:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.768882:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940014976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.768908:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.768920:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.768930:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940015360:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.768960:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.768965:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789427774.768975:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940014080:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.768985:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789427774.768994:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940014208:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769006:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.769028:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.769031:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940014592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769057:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940014720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769064:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.769102:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940015104:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769102:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.769130:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940015232:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769137:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427774.769164:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427774.769177:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013952 00000100:00100000:3.0:1789427774.769186:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013952 00000100:00100000:2.0:1789427774.769201:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014336 00000100:00100000:2.0:1789427774.769207:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014336 00000100:00100000:3.0:1789427774.769238:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014464 00000100:00100000:3.0:1789427774.769243:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014464 00000100:00100000:2.0:1789427774.769244:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014080 00000100:00100000:2.0:1789427774.769250:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014080 00000100:00100000:2.0:1789427774.769268:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789427774.769279:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014976 00000100:00100000:3.0:1789427774.769284:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014976 00000100:00100000:2.0:1789427774.769287:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940014336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769301:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014208 00000100:00100000:3.0:1789427774.769305:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014208 00000100:00100000:3.0:1789427774.769319:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014592 00000100:00100000:3.0:1789427774.769322:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014592 00000100:00100000:3.0:1789427774.769339:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015104 00000100:00100000:3.0:1789427774.769342:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015104 00000100:00100000:2.0:1789427774.769359:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940014336:12345-0@lo:400:kworker.0 Request processed in 75us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.769364:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427774.769372:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789427774.769378:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769399:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789427774.769408:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940014080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769450:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940013952:12345-0@lo:400:kworker.0 Request processed in 76us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.769458:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427774.769469:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940014080:12345-0@lo:400:kworker.0 Request processed in 62us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.769481:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427774.769481:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789427774.769495:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940014464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769510:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014848 00000100:00100000:2.0:1789427774.769516:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014848 00000100:00100000:3.0:1789427774.769530:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940014464:12345-0@lo:400:kworker.0 Request processed in 38us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.769537:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427774.769541:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015360 00000100:00100000:2.0:1789427774.769545:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015360 00000100:00100000:3.0:1789427774.769554:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789427774.769564:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769564:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940014720 00000100:00100000:2.0:1789427774.769568:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940014720 00000100:00100000:2.0:1789427774.769589:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015232 00000100:00100000:2.0:1789427774.769592:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015232 00000100:00100000:3.0:1789427774.769601:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940014976:12345-0@lo:400:kworker.0 Request processed in 39us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.769609:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789427774.769613:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789427774.769623:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940014848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769629:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789427774.769639:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940014208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769661:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940014848:12345-0@lo:400:kworker.0 Request processed in 39us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769669:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789427774.769680:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940014208:12345-0@lo:400:kworker.0 Request processed in 42us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769685:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789427774.769690:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789427774.769697:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940015360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769710:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789427774.769718:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940014592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769733:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940015360:12345-0@lo:400:kworker.0 Request processed in 38us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769740:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789427774.769758:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940014592:12345-0@lo:400:kworker.0 Request processed in 39us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769765:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789427774.769770:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427774.769776:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940014720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769789:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789427774.769798:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940015104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769813:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940014720:12345-0@lo:400:kworker.0 Request processed in 37us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769820:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427774.769836:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789427774.769843:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940015104:12345-0@lo:400:kworker.0 Request processed in 45us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769847:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.769856:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789427774.769883:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940015232:12345-0@lo:400:kworker.0 Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427774.769889:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789427774.769917:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940014080:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769925:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940014208:0@lo:400:kworker.0 00010000:00080000:3.0:1789427774.769939:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6a300 x1876350940014592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789427774.769945:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68a80 x1876350940014720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427774.769960:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940014592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.769966:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940014720:0@lo:400:kworker.0 00010000:00080000:3.0:1789427774.769979:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f800 x1876350940015104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789427774.769985:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c97b80 x1876350940015232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427774.769993:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940015104:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.770005:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940015232:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.770013:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940013952:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.770023:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940014336:0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.770030:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940014464:0@lo:400:kworker.0 00010000:00080000:2.0:1789427774.770041:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bd880 x1876350940014848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427774.770047:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940014976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427774.770057:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940014848:0@lo:400:kworker.0 00010000:00080000:2.0:1789427774.770075:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c95500 x1876350940015360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789427774.770158:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427774.770164:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427774.770167:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427774.770170:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427774.770208:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427774.770219:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940015488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427774.770252:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427774.770285:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015488 00000100:00100000:0.0:1789427774.770290:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015488 00000100:00100000:0.0:1789427774.770324:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427774.770332:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940015488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427774.770358:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427774.770397:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940015488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427774.770403:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789427774.770446:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc81880 x1876350940015488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427774.770460:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940015488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427774.771531:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940013824 00000100:00100000:3.0:1789427774.771537:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940013824 00000100:00100000:3.0:1789427774.771569:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789427774.771575:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940013824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427774.771615:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940013824:12345-0@lo:400:kworker.0 Request processed in 40us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427774.771620:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789427774.772215:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940015360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427774.772379:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940015616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427774.772444:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427774.772481:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015616 00000100:00100000:1.0:1789427774.772485:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015616 00000100:00100000:1.0:1789427774.772512:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789427774.772520:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940015616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427774.772533:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427774.772565:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940015616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427774.772572:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789427774.772604:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539180 x1876350940015616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427774.772626:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940013824:0@lo:400:kworker.0 00000100:00100000:1.0:1789427774.773699:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940015616:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789427774.898915:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427775.041610:0:10659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789427775.792636:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940015872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427775.792646:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940015744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427775.792758:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427775.792814:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015872 00000100:00100000:0.0:1789427775.792822:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015872 00000100:00100000:0.0:1789427775.792907:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427775.792914:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940015872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427775.792937:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427775.792973:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940015872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427775.792990:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789427775.793120:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc81880 x1876350940015872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427775.793140:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940015872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427775.793291:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427775.793358:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940015744 00000100:00100000:0.0:1789427775.793362:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940015744 00000100:00100000:0.0:1789427775.793382:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427775.793387:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940015744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427775.793396:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427775.793461:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940015744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (168us total) trans 0 rc 0/0 00010000:00080000:1.0:1789427775.793467:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c95500 x1876350940015744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427775.793472:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789427775.793484:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940015744:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427775.920591:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427776.816657:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427776.816678:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940016000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427776.816742:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427776.817151:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016000 00000100:00100000:0.0:1789427776.817160:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016000 00000100:00100000:0.0:1789427776.817213:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427776.817222:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940016000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427776.817253:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427776.817301:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940016000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.817308:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427776.817351:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940016000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427776.946393:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427777.872718:0:10902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing yml_node 00010000:00010000:0.0:1789427777.970010:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427778.019189:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427778.019240:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427778.019243:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931573888 00000100:00100000:1.0:1789427778.019254:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931573888 00000100:00100000:3.0:1789427778.019279:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427778.019289:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574144 00000100:00100000:0.0:1789427778.019295:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574144 00000100:00100000:1.0:1789427778.019311:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 267 00000100:00100000:3.0:1789427778.019314:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427778.019327:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2394:x1876350931573888:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427778.019339:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574016 00000100:00100000:0.0:1789427778.019356:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574016 00000100:00100000:3.0:1789427778.019357:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427778.019387:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1789427778.019393:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574400 00000100:00100000:0.0:1789427778.019397:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574144:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427778.019401:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574400 00000100:00100000:1.0:1789427778.019401:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2394:x1876350931573888:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427778.019457:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 267 00000100:00100000:3.0:1789427778.019470:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574272 00000100:00100000:3.0:1789427778.019475:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574272 00000100:00100000:3.0:1789427778.019509:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789427778.019518:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574400:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427778.019569:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574400:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427778.019577:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789427778.019586:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574144:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 190us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427778.019594:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789427778.019604:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574272:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427778.019610:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1789427778.019632:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789427778.019647:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931574016:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427778.019703:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931574016:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 63us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427778.019709:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00080000:0.0:1789427778.019730:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427778.019734:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427778.019737:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427778.019740:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427778.019833:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931574272:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 232us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427778.019839:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00010000:00010000:2.0:1789427778.992663:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427779.377483:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940016128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427779.377593:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427779.377699:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016128 00000100:00100000:2.0:1789427779.377714:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016128 00000100:00100000:2.0:1789427779.377898:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427779.377912:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940016128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427779.377967:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427779.378034:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940016128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427779.378042:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789427779.378106:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940016128:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789427779.673572:0:11085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00000100:00100000:0.0:1789427779.888601:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940016256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427779.888695:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.888771:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427779.888782:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940016768:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.888822:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.888852:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940016384:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.888907:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.888949:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940017280:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.888999:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427779.889010:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940016512:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889027:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940017792:0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.889064:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889072:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889104:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789427779.889110:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940016896:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889135:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889153:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940017408:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889172:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427779.889214:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940017024:0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.889250:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889277:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016256 00000100:00100000:0.0:1789427779.889288:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016256 00000100:00100000:3.0:1789427779.889291:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940017536:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889351:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789427779.889360:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940016256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427779.889396:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427779.889461:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889493:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940016256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427779.889494:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789427779.889503:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427779.889542:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940016640:0@lo:400:kworker.0 00000100:00100000:2.0:1789427779.889550:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940017920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427779.889572:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427779.889598:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940017152:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889605:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016768 00000100:00100000:0.0:1789427779.889610:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016768 00000100:00100000:2.0:1789427779.889611:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427779.889625:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427779.889670:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016896 00000100:00100000:2.0:1789427779.889676:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016896 00000100:00100000:2.0:1789427779.889708:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016640 00000100:00100000:2.0:1789427779.889711:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016640 00000100:00100000:0.0:1789427779.889724:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016512 00000100:00100000:0.0:1789427779.889729:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016512 00000100:00100000:2.0:1789427779.889738:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789427779.889741:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940017664:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889750:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017024 00000100:00100000:2.0:1789427779.889751:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940016896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889754:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017024 00000100:00100000:3.0:1789427779.889771:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427779.889780:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017536 00000100:00100000:0.0:1789427779.889785:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017536 00000100:00100000:3.0:1789427779.889804:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940016384 00000100:00100000:2.0:1789427779.889809:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940016896:12345-0@lo:400:kworker.0 Request processed in 61us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427779.889810:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940016384 00000100:00100000:0.0:1789427779.889810:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017152 00000100:00100000:0.0:1789427779.889817:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017152 00000100:00100000:2.0:1789427779.889828:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427779.889852:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789427779.889854:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789427779.889856:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017664 00000100:00100000:0.0:1789427779.889861:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017664 00000100:00100000:2.0:1789427779.889863:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940016640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.889868:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940016384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.889885:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789427779.889895:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940016768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.889915:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940016384:12345-0@lo:400:kworker.0 Request processed in 50us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427779.889922:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940016640:12345-0@lo:400:kworker.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427779.889926:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789427779.889936:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789427779.889943:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940016768:12345-0@lo:400:kworker.0 Request processed in 49us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427779.889951:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427779.889962:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017920 00000100:00100000:2.0:1789427779.889967:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017920 00000100:00100000:0.0:1789427779.889972:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789427779.889981:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940016512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427779.890000:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789427779.890010:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940017920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427779.890023:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427779.890023:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940016512:12345-0@lo:400:kworker.0 Request processed in 41us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427779.890028:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789427779.890038:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789427779.890052:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940017024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890084:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789427779.890090:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940017920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427779.890097:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.890098:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940017024:12345-0@lo:400:kworker.0 Request processed in 57us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427779.890108:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427779.890115:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789427779.890137:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427779.890146:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940017152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890153:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940017536:12345-0@lo:400:kworker.0 Request processed in 61us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427779.890162:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789427779.890163:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcbbf480 x1876350940017920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890184:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789427779.890185:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940017152:12345-0@lo:400:kworker.0 Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427779.890187:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940017920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427779.890199:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940017664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.890201:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427779.890242:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940016640:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890249:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940017664:12345-0@lo:400:kworker.0 Request processed in 50us (476us total) trans 0 rc 0/0 00010000:00080000:2.0:1789427779.890260:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c96a00 x1876350940017152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890260:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789427779.890273:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940017152:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890288:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017280 00010000:00080000:2.0:1789427779.890289:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361f800 x1876350940017664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890294:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017280 00000100:00100000:2.0:1789427779.890316:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940017664:0@lo:400:kworker.0 00000100:00100000:2.0:1789427779.890331:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940016512:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890331:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017792 00000100:00100000:0.0:1789427779.890336:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017792 00000100:00100000:2.0:1789427779.890347:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940017024:0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.890352:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940017408 00000100:00100000:3.0:1789427779.890358:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940017408 00000100:00100000:0.0:1789427779.890358:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427779.890363:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940017536:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890378:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940017280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.890393:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427779.890410:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940017792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890448:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940017280:12345-0@lo:400:kworker.0 Request processed in 74us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427779.890454:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427779.890471:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940017792:12345-0@lo:400:kworker.0 Request processed in 62us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427779.890471:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427779.890484:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940017408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427779.890485:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789427779.890515:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427779.890517:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940017408:12345-0@lo:400:kworker.0 Request processed in 38us (1344us total) trans 0 rc 0/0 00000100:00080000:2.0:1789427779.890523:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427779.890523:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789427779.890529:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427779.890533:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427779.890568:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940016896:0@lo:400:kworker.0 00010000:00080000:0.0:1789427779.890584:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bd880 x1876350940017408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890594:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940017408:0@lo:400:kworker.0 00010000:00080000:0.0:1789427779.890606:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c95500 x1876350940017280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890614:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940017280:0@lo:400:kworker.0 00010000:00080000:0.0:1789427779.890623:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb6a680 x1876350940017792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890632:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940017792:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890641:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940016768:0@lo:400:kworker.0 00000100:00100000:0.0:1789427779.890649:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940016384:0@lo:400:kworker.0 00010000:00080000:0.0:1789427779.890660:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc81880 x1876350940016256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427779.890681:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940016256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427780.016637:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427780.913603:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427780.913696:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427780.913797:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018048 00000100:00100000:3.0:1789427780.913815:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018048 00000100:00100000:3.0:1789427780.913937:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427780.913946:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427780.913985:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427780.914062:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427780.914070:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789427780.914197:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68700 x1876350940018048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427780.914224:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427780.914297:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940018176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427780.914324:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427780.915304:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018176 00000100:00100000:2.0:1789427780.915313:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018176 00000100:00100000:2.0:1789427780.915435:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427780.915448:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940018176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427780.915466:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427780.915527:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940018176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427780.915536:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789427780.915549:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196adb68700 x1876350940018176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427780.915567:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940018176:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427781.040680:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427781.123351:0:11183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00000100:00100000:1.0:1789427781.937903:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940018304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427781.938006:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427781.938197:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018304 00000100:00100000:0.0:1789427781.938207:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018304 00000100:00100000:0.0:1789427781.938282:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789427781.938298:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940018304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427781.938344:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427781.938449:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940018304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427781.938458:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789427781.938515:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940018304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427782.067103:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427782.966985:0:11280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00010000:00010000:0.0:1789427783.088639:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427783.139775:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427783.139815:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427783.139834:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427783.139924:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427783.139954:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427783.140006:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574528 00000100:00100000:3.0:1789427783.140028:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574528 00000100:00100000:3.0:1789427783.140076:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 269 00000100:00100000:3.0:1789427783.140085:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931574528:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427783.140149:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931574528:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427783.140169:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 269 00000100:00100000:3.0:1789427783.140206:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574784 00000100:00100000:3.0:1789427783.140209:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574784 00000100:00100000:3.0:1789427783.140240:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574656 00000100:00100000:3.0:1789427783.140243:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574656 00000100:00100000:3.0:1789427783.140261:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789427783.140267:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931574784:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427783.140294:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931574784:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427783.140300:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789427783.140311:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1789427783.140316:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931574656:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427783.140335:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931574656:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 19us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427783.140341:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:2.0:1789427783.140633:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575040 00000100:00100000:2.0:1789427783.140638:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575040 00000100:00100000:2.0:1789427783.140700:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931574912 00000100:00100000:2.0:1789427783.140703:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931574912 00000100:00100000:0.0:1789427783.140812:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1789427783.140821:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931575040:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427783.140941:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931575040:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 120us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427783.140948:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1789427783.140964:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1789427783.140970:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931574912:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427783.140992:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931574912:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 23us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427783.141004:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00080000:2.0:1789427783.141070:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427783.141074:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427783.141077:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427783.141079:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1789427784.068900:0:11328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 19:16:22 EDT 2026 00010000:00010000:1.0:1789427784.112760:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427784.497336:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940018432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427784.497561:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427784.499210:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018432 00000100:00100000:3.0:1789427784.499222:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018432 00000100:00100000:3.0:1789427784.499291:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427784.499304:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940018432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427784.499352:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427784.499474:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940018432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 173us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427784.499482:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789427784.499554:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940018432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427785.008618:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940018560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427785.008764:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.008899:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018560 00000100:00100000:0.0:1789427785.008914:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018560 00000100:00100000:0.0:1789427785.009016:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427785.009030:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940018560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427785.009085:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427785.009155:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940018560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427785.009163:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789427785.009197:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789427785.009250:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd71180 x1876350940018560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427785.009277:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940018560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427785.009849:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940018688:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.009911:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.009945:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940019200:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.009982:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.010026:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940019712:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010066:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.010098:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789427785.010106:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940019072:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010142:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.010167:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940018944:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010170:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940019584:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010220:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.010221:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.010249:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020096:0@lo:400:kworker.0 00000100:00100000:0.0:1789427785.010254:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940019456:0@lo:400:kworker.0 00000100:00100000:0.0:1789427785.010292:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.010304:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.010318:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940019968:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010334:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427785.010367:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427785.010373:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.010398:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789427785.010407:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940018816:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010465:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018688 00000100:00100000:1.0:1789427785.010473:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018688 00000100:00100000:1.0:1789427785.010521:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789427785.010531:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010577:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940018688:12345-0@lo:400:kworker.0 Request processed in 47us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.010585:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789427785.010624:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019200 00000100:00100000:1.0:1789427785.010628:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019200 00000100:00100000:1.0:1789427785.010652:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018944 00000100:00100000:1.0:1789427785.010654:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018944 00000100:00100000:1.0:1789427785.010669:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427785.010675:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940019200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010713:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940019200:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.010719:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427785.010731:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789427785.010737:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010765:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940018944:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.010771:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789427785.010789:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019712 00000100:00100000:1.0:1789427785.010792:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019712 00000100:00100000:1.0:1789427785.010824:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019584 00000100:00100000:1.0:1789427785.010833:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019584 00000100:00100000:1.0:1789427785.010852:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020096 00000100:00100000:1.0:1789427785.010854:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020096 00000100:00100000:1.0:1789427785.010872:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427785.010879:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010910:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940019712:12345-0@lo:400:kworker.0 Request processed in 32us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.010916:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427785.010930:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427785.010936:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.010964:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940019584:12345-0@lo:400:kworker.0 Request processed in 27us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.010969:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427785.010980:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427785.010986:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011025:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020096:12345-0@lo:400:kworker.0 Request processed in 40us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.011032:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427785.011054:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019072 00000100:00100000:1.0:1789427785.011058:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019072 00000100:00100000:1.0:1789427785.011086:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019456 00000100:00100000:1.0:1789427785.011089:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019456 00000100:00100000:1.0:1789427785.011113:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019968 00000100:00100000:1.0:1789427785.011116:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019968 00000100:00100000:1.0:1789427785.011134:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789427785.011141:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011171:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940019072:12345-0@lo:400:kworker.0 Request processed in 31us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.011185:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789427785.011202:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789427785.011208:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940019456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011236:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940019456:12345-0@lo:400:kworker.0 Request processed in 28us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.011242:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789427785.011255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789427785.011262:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011288:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940019968:12345-0@lo:400:kworker.0 Request processed in 28us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.011293:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789427785.011319:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020224 00000100:00100000:1.0:1789427785.011323:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020224 00000100:00100000:1.0:1789427785.011343:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427785.011349:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427785.011363:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427785.011391:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427785.011397:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789427785.011462:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd71180 x1876350940020224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427785.011480:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427785.011493:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940019072:0@lo:400:kworker.0 00010000:00080000:1.0:1789427785.011502:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583538000 x1876350940019584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427785.011516:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940019584:0@lo:400:kworker.0 00010000:00080000:1.0:1789427785.011527:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958370a680 x1876350940020096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427785.011534:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020096:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011543:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940018688:0@lo:400:kworker.0 00000100:00100000:1.0:1789427785.011551:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940019200:0@lo:400:kworker.0 00010000:00080000:1.0:1789427785.011560:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539f80 x1876350940019712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427785.011568:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940019712:0@lo:400:kworker.0 00000100:00080000:1.0:1789427785.011648:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427785.011653:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427785.011656:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427785.015162:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.015222:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940019328:0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.015229:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940018816 00000100:00100000:2.0:1789427785.015250:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940018816 00000100:00100000:0.0:1789427785.015252:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.015277:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940019840:0@lo:400:kworker.0 00000100:00100000:0.0:1789427785.015301:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427785.016605:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019328 00000100:00100000:2.0:1789427785.016612:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019328 00000100:00100000:2.0:1789427785.016656:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940019840 00000100:00100000:2.0:1789427785.016659:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940019840 00000100:00100000:2.0:1789427785.016678:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789427785.016689:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427785.016720:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940018944:0@lo:400:kworker.0 00010000:00080000:0.0:1789427785.016744:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539c00 x1876350940019456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427785.016756:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940019456:0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.016762:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940018816:12345-0@lo:400:kworker.0 Request processed in 72us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427785.016770:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789427785.016777:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583708a80 x1876350940019968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427785.016788:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940019968:0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.016793:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789427785.016800:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940019328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427785.016826:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940018816:0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.016832:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940019328:12345-0@lo:400:kworker.0 Request processed in 31us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427785.016840:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789427785.016845:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940019328:0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.016865:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789427785.016874:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940019840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427785.016914:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940019840:12345-0@lo:400:kworker.0 Request processed in 43us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427785.016918:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789427785.017164:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427785.017786:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940019840:0@lo:400:kworker.0 00010000:00010000:1.0:1789427785.137057:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427786.033573:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427786.033604:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940020352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427786.033861:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427786.033941:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020352 00000100:00100000:0.0:1789427786.033951:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020352 00000100:00100000:0.0:1789427786.034175:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789427786.034191:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940020352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427786.034228:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427786.034276:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940020352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427786.034284:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789427786.034334:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24a80 x1876350940020352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427786.034355:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940020352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427786.036476:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940020480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427786.036557:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427786.036668:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020480 00000100:00100000:3.0:1789427786.036679:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020480 00000100:00100000:3.0:1789427786.036734:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427786.036745:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940020480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427786.036770:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427786.036828:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940020480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427786.036835:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789427786.036899:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24a80 x1876350940020480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427786.036917:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940020480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427786.162058:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427787.056620:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427787.056643:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427787.056711:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427787.056854:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020608 00000100:00100000:3.0:1789427787.056864:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020608 00000100:00100000:3.0:1789427787.056921:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789427787.056932:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427787.056967:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427787.057175:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940020608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 244us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427787.057183:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789427787.057250:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940020608:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427787.185478:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427788.209586:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427788.260649:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427788.260701:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427788.260866:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575168 00000100:00100000:3.0:1789427788.260879:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575168 00000100:00100000:3.0:1789427788.260938:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 271 00000100:00100000:3.0:1789427788.260947:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2397:x1876350931575168:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427788.261032:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2397:x1876350931575168:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 87us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427788.261039:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 271 00000100:00100000:2.0:1789427788.261317:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575424 00000100:00100000:2.0:1789427788.261321:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575424 00000100:00100000:2.0:1789427788.261505:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:2.0:1789427788.261516:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931575424:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:3.0:1789427788.261528:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427788.261563:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931575424:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 50us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427788.261571:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:0.0:1789427788.262390:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427788.262445:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575296 00000100:00100000:2.0:1789427788.262451:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575296 00000100:00080000:3.0:1789427788.262478:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427788.262501:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1789427788.262510:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931575296:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427788.262556:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931575296:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427788.262563:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1789427788.263108:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427788.263166:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427788.263349:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575552 00000100:00100000:3.0:1789427788.263355:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575552 00000100:00100000:3.0:1789427788.263411:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575680 00000100:00100000:3.0:1789427788.263441:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575680 00000100:00100000:3.0:1789427788.263480:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1789427788.263490:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931575552:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:3.0:1789427788.263524:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518308 00000100:00080000:3.0:1789427788.263538:0:8400:0:(import.c:65:import_set_state_nolock()) ffff919583036800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427788.263600:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789427788.263784:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+2:2393:x1876350931575552:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 296us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427788.263792:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1789427788.263809:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789427788.263828:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931575680:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:3.0:1789427788.263845:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518301 00000100:00080000:3.0:1789427788.263853:0:8400:0:(import.c:65:import_set_state_nolock()) ffff9195837a9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427788.263877:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789427788.263959:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+2:2393:x1876350931575680:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 133us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427788.263991:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00010000:00010000:3.0:1789427788.264093:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427788.264216:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427788.264220:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427788.265054:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427789.247752:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427789.616639:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940020736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427789.616735:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427789.616873:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020736 00000100:00100000:0.0:1789427789.616890:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020736 00000100:00100000:0.0:1789427789.616945:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789427789.616976:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940020736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789427789.617022:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789427789.617091:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940020736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427789.617099:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789427789.617155:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940020736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427790.128692:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940020864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427790.128770:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427790.128860:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020864 00000100:00100000:3.0:1789427790.128867:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020864 00000100:00100000:3.0:1789427790.128917:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427790.128988:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940020864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427790.129031:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427790.129143:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940020864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 218us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427790.129168:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789427790.129188:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789427790.129231:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5880 x1876350940020864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427790.129250:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940020864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427790.130793:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940020992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.130795:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940021120:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.130857:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427790.130885:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940021504:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.130918:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940021248:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.130919:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.130962:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.130992:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940021760:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131017:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.131035:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940022272:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131054:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.131385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.131410:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940021632:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131452:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.131467:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940022144:0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131485:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427790.131514:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021504 00000100:00100000:2.0:1789427790.131519:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021504 00000100:00100000:2.0:1789427790.131569:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021120 00000100:00100000:2.0:1789427790.131572:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021120 00000100:00100000:2.0:1789427790.131582:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021632 00000100:00100000:2.0:1789427790.131584:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021632 00000100:00100000:2.0:1789427790.131605:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022144 00000100:00100000:2.0:1789427790.131608:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022144 00000100:00100000:2.0:1789427790.131623:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789427790.131630:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940021504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131668:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940021504:12345-0@lo:400:kworker.0 Request processed in 38us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427790.131674:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789427790.131688:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789427790.131694:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131742:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940021120:12345-0@lo:400:kworker.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427790.131747:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789427790.131767:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789427790.131773:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940021632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131818:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940021632:12345-0@lo:400:kworker.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427790.131824:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789427790.131835:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427790.131841:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940022144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427790.131862:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940022144:12345-0@lo:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427790.131867:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427790.131899:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940021120:0@lo:400:kworker.0 00010000:00080000:2.0:1789427790.131912:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6d80 x1876350940021632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427790.131922:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940021632:0@lo:400:kworker.0 00010000:00080000:2.0:1789427790.131942:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5500 x1876350940022144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427790.131959:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940022144:0@lo:400:kworker.0 00000100:00100000:0.0:1789427790.132268:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021760 00000100:00100000:0.0:1789427790.132274:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021760 00000100:00100000:0.0:1789427790.132341:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022272 00000100:00100000:0.0:1789427790.132345:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022272 00000100:00100000:1.0:1789427790.132379:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427790.132388:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940021760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132502:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940021504:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132511:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940022016:0@lo:400:kworker.0 00000100:00100000:1.0:1789427790.132518:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940021760:12345-0@lo:400:kworker.0 Request processed in 131us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427790.132530:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427790.132548:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427790.132550:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427790.132560:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132580:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789427790.132596:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940021376:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132618:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427790.132638:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940021888:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132663:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427790.132679:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940022400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427790.132683:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021888 00000100:00100000:0.0:1789427790.132695:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021888 00000100:00100000:3.0:1789427790.132707:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427790.132721:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427790.132728:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.132772:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022016 00000100:00100000:0.0:1789427790.132775:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940021888:12345-0@lo:400:kworker.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427790.132778:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022016 00000100:00100000:0.0:1789427790.132784:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427790.132807:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021248 00000100:00100000:0.0:1789427790.132811:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021248 00000100:00100000:3.0:1789427790.132840:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940021376 00000100:00100000:3.0:1789427790.132845:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940021376 00000100:00100000:3.0:1789427790.132869:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427790.132887:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427790.132942:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789427790.132961:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940021248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427790.135097:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940022272:12345-0@lo:400:kworker.0 Request processed in 2536us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427790.135105:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940022016:12345-0@lo:400:kworker.0 Request processed in 2216us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427790.135112:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427790.135119:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427790.135146:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427790.135169:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940021376:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789427790.135171:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4a80 x1876350940021760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427790.135185:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940021760:0@lo:400:kworker.0 00010000:00080000:1.0:1789427790.135198:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4380 x1876350940022272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427790.135206:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940022272:0@lo:400:kworker.0 00000100:00100000:3.0:1789427790.135230:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940021376:12345-0@lo:400:kworker.0 Request processed in 76us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427790.135237:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427790.135257:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022400 00000100:00100000:3.0:1789427790.135262:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022400 00000100:00100000:3.0:1789427790.135296:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427790.135304:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940022400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427790.135318:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427790.135350:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940022400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427790.135356:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789427790.135391:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427790.135396:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427790.135400:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427790.135402:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427790.135575:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940021376:0@lo:400:kworker.0 00010000:00080000:3.0:1789427790.135589:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6680 x1876350940021888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427790.135599:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940021888:0@lo:400:kworker.0 00010000:00080000:3.0:1789427790.135610:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24700 x1876350940022400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427790.135632:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940022400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427790.135647:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940022016:0@lo:400:kworker.0 00000100:00100000:0.0:1789427790.135721:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940021248:12345-0@lo:400:kworker.0 Request processed in 2769us (4757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427790.135731:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789427790.135757:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940020992 00000100:00100000:0.0:1789427790.135761:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940020992 00000100:00100000:0.0:1789427790.135792:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789427790.135798:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940020992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427790.135909:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940021248:0@lo:400:kworker.0 00000100:00100000:0.0:1789427790.135935:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940020992:12345-0@lo:400:kworker.0 Request processed in 41us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427790.135940:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789427790.135989:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940020992:0@lo:400:kworker.0 00010000:00010000:1.0:1789427790.258046:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427791.153573:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940022528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427791.153659:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427791.153778:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022528 00000100:00100000:0.0:1789427791.153789:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022528 00000100:00100000:0.0:1789427791.153849:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789427791.153861:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940022528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427791.153897:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427791.153985:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940022528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427791.153993:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789427791.154036:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24000 x1876350940022528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427791.154057:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940022528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427791.154164:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940022656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427791.154199:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427791.154782:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022656 00000100:00100000:3.0:1789427791.154787:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022656 00000100:00100000:3.0:1789427791.154847:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427791.154855:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940022656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427791.154866:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427791.154898:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940022656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427791.154904:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789427791.154962:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df5880 x1876350940022656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427791.154976:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940022656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427791.285155:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427792.177826:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427792.177847:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940022784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427792.177912:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427792.177962:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022784 00000100:00100000:2.0:1789427792.177970:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022784 00000100:00100000:2.0:1789427792.178016:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789427792.178025:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940022784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427792.178057:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427792.178112:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940022784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427792.178126:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789427792.178218:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940022784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427792.305176:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427793.328646:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427793.381185:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427793.381288:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427793.381324:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427793.381358:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575936 00000100:00100000:0.0:1789427793.381369:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575936 00000100:00080000:3.0:1789427793.381459:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427793.381480:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576064 00000100:00100000:0.0:1789427793.381485:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576064 00000100:00100000:3.0:1789427793.381500:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1789427793.381514:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931575936:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427793.381521:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:3.0:1789427793.381582:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931575936:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427793.381602:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00080000:3.0:1789427793.381640:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427793.381665:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931576064:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427793.381700:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931576064:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 170us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427793.381708:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:1.0:1789427793.382359:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931575808 00000100:00100000:1.0:1789427793.382365:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931575808 00000100:00100000:1.0:1789427793.382404:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 273 00000100:00100000:1.0:1789427793.382619:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931575808:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427793.382719:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2396:x1876350931575808:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 307us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427793.382727:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 273 00000001:02000400:2.0:1789427794.026757:0:11956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:16:32 (1789427792) === 00000001:00100000:2.0:1789427794.226112:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:2.0:1789427794.226119:0:8395:0:(genops.c:885:class_export_put()) final put ffff9195837e3000/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:0.0:1789427794.226162:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e3000/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-OST0000 00000020:00000080:0.0:1789427794.226209:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583036800 for lustre-OST0000 00000001:00100000:1.0:1789427794.226362:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:1.0:1789427794.226366:0:9478:0:(genops.c:885:class_export_put()) final put ffff9195837af800/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:0.0:1789427794.226431:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837af800/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-OST0001 00000020:00000080:0.0:1789427794.226463:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837a9000 for lustre-OST0001 00010000:00010000:1.0:1789427794.353460:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427794.563855:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.563959:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576192 00000100:00100000:0.0:1789427794.564061:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576192 00000100:00100000:0.0:1789427794.565497:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 274 00000100:00100000:0.0:1789427794.565510:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:8700:x1876350931576192:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789427794.565526:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427794.565544:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208400/0x84fc867ede5183f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.565573:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208400/0x84fc867ede5183f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a57 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.565585:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208400/0x84fc867ede5183f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a57 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.565593:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208400, rc 0) 00000100:00100000:0.0:1789427794.565654:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576192:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 148us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.565661:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 274 00000100:00100000:0.0:1789427794.568303:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.568441:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576320 00000100:00100000:1.0:1789427794.568452:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576320 00000100:00100000:1.0:1789427794.568563:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:1.0:1789427794.568609:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576320:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789427794.568822:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576320:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 249us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.568830:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:2.0:1789427794.573374:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.573543:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576448 00000100:00100000:0.0:1789427794.573555:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576448 00000100:00100000:0.0:1789427794.573669:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:0.0:1789427794.573681:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576448:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789427794.573838:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576448:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 159us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.573846:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:3.0:1789427794.575817:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.576107:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576576 00000100:00100000:1.0:1789427794.576115:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576576 00000100:00100000:1.0:1789427794.576205:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:1.0:1789427794.576216:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576576:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427794.576398:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576576:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 183us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.576405:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:2.0:1789427794.595591:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.595712:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576704 00000100:00100000:0.0:1789427794.595736:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576704 00000100:00100000:0.0:1789427794.595864:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00100000:0.0:1789427794.595876:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576704:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789427794.596058:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576704:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 184us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.596065:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00100000:2.0:1789427794.597892:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.598061:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576832 00000100:00100000:1.0:1789427794.598073:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576832 00000100:00100000:1.0:1789427794.598145:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 279 00000100:00100000:1.0:1789427794.598158:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576832:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427794.598310:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8704:x1876350931576832:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 155us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.598319:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 279 00000100:00100000:3.0:1789427794.599939:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.600018:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931576960 00000100:00100000:0.0:1789427794.600025:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931576960 00000100:00100000:0.0:1789427794.600077:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 280 00000100:00100000:0.0:1789427794.600089:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:8700:x1876350931576960:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789427794.600103:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427794.600133:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208c00/0x84fc867ede5183fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a88 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.600173:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208c00/0x84fc867ede5183fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a88 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.600188:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208c00/0x84fc867ede5183fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a88 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.600199:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208c00, rc 0) 00000100:00100000:0.0:1789427794.600278:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:8700:x1876350931576960:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 192us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.600286:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 280 00000100:00100000:2.0:1789427794.603089:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.603233:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577088 00000100:00100000:1.0:1789427794.603242:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577088 00000100:00100000:1.0:1789427794.603294:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 281 00000100:00100000:1.0:1789427794.603303:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:8700:x1876350931577088:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789427794.603338:0:6475:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789427794.603356:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789427794.603370:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789427794.603374:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789427794.603377:0:6475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789427794.603380:0:6475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789427794.605516:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:8700:x1876350931577088:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 2207us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.605528:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 281 00000100:00100000:3.0:1789427794.607199:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.607299:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577216 00000100:00100000:0.0:1789427794.607309:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577216 00000100:00100000:0.0:1789427794.607357:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 282 00000100:00100000:0.0:1789427794.607367:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:8700:x1876350931577216:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789427794.607393:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427794.607531:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300a8f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.607565:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.607579:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427794.607589:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209600, rc 0) 00000100:00100000:0.0:1789427794.607628:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8700:x1876350931577216:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 263us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.607635:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 282 00000100:00100000:2.0:1789427794.608621:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.608692:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577344 00000100:00100000:1.0:1789427794.608698:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577344 00000100:00100000:1.0:1789427794.608736:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 283 00000100:00100000:1.0:1789427794.608745:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8700:x1876350931577344:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789427794.609007:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8700:x1876350931577344:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 262us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.609016:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 283 00000100:00100000:2.0:1789427794.609958:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.610217:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577472 00000100:00100000:0.0:1789427794.610222:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577472 00000100:00100000:0.0:1789427794.610282:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 284 00000100:00100000:0.0:1789427794.610290:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8700:x1876350931577472:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789427794.610383:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8700:x1876350931577472:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.610391:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 284 00000100:00100000:3.0:1789427794.611611:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427794.611746:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577600 00000100:00100000:1.0:1789427794.611752:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577600 00000100:00100000:1.0:1789427794.611785:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 285 00000100:00100000:1.0:1789427794.611792:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8709:x1876350931577600:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427794.611924:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8709:x1876350931577600:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427794.611933:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 285 00000100:00100000:2.0:1789427794.613377:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.613548:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577728 00000100:00100000:0.0:1789427794.613555:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577728 00000100:00100000:0.0:1789427794.613627:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:0.0:1789427794.613637:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8709:x1876350931577728:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789427794.613725:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:8709:x1876350931577728:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 89us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.613739:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:2.0:1789427794.616745:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.616777:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.616805:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.616833:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.616875:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577856 00000100:00100000:2.0:1789427794.616884:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577856 00000100:00100000:2.0:1789427794.616935:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931577984 00000100:00100000:2.0:1789427794.616938:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931577984 00000100:00100000:2.0:1789427794.616963:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578240 00000100:00100000:2.0:1789427794.616965:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578240 00000100:00100000:2.0:1789427794.616976:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578368 00000100:00100000:2.0:1789427794.616978:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578368 00000100:00100000:2.0:1789427794.616989:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1789427794.616998:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931577984:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427794.617060:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931577984:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.617082:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1789427794.617098:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1789427794.617104:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931578240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427794.617128:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931578240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.617134:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1789427794.617144:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789427794.617148:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1876350931577856:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789427794.617173:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 380d3950-14fb-41fe-b87d-b6d5bf049758@192.168.202.24@tcp t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:2.0:1789427794.617213:0:6484:0:(genops.c:1384:class_connect()) connect: client 380d3950-14fb-41fe-b87d-b6d5bf049758, cookie 0x84fc867ede51840b 00000004:00100000:2.0:1789427794.617241:0:6484:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789427794.617360:0:6484:0:(import.c:65:import_set_state_nolock()) ffff919583439000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427794.617388:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2393:x1876350931577856:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 238us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.617394:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789427794.617405:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789427794.617409:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1876350931578368:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789427794.617461:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 380d3950-14fb-41fe-b87d-b6d5bf049758@192.168.202.24@tcp t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:2.0:1789427794.617484:0:6484:0:(genops.c:1384:class_connect()) connect: client 380d3950-14fb-41fe-b87d-b6d5bf049758, cookie 0x84fc867ede518412 00000004:00100000:2.0:1789427794.617495:0:6484:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789427794.617547:0:6484:0:(import.c:65:import_set_state_nolock()) ffff91958343e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427794.617567:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2393:x1876350931578368:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 156us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.617583:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:3.0:1789427794.619545:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.619655:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578496 00000100:00100000:2.0:1789427794.619663:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578496 00000100:00080000:3.0:1789427794.619758:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427794.620508:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:2.0:1789427794.620520:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:0:x1876350931578496:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789427794.620551:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427794.620639:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:0:x1876350931578496:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 121us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.620646:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1789427794.621207:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.621252:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427794.621315:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578112 00000100:00100000:3.0:1789427794.621321:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578112 00000100:00100000:3.0:1789427794.621365:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578624 00000100:00100000:3.0:1789427794.621368:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578624 00000100:00100000:3.0:1789427794.621387:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789427794.621393:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+7:0:x1876350931578112:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789427794.621411:0:6482:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:0.0:1789427794.621638:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427794.621691:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:2.0:1789427794.621700:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+7:8700:x1876350931578624:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789427794.621715:0:10064:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427794.621808:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+7:8700:x1876350931578624:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 109us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.621815:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789427794.621847:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:0:x1876350931578112:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 454us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427794.621854:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:2.0:1789427794.623785:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427794.623959:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578752 00000100:00100000:3.0:1789427794.623967:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578752 00000100:00100000:3.0:1789427794.624021:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789427794.624032:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931578752:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789427794.624102:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931578752:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427794.624111:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1789427794.629815:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427794.629849:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427794.629946:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931578880 00000100:00100000:3.0:1789427794.629958:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931578880 00000100:00100000:0.0:1789427794.630004:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427794.630062:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579008 00000100:00100000:3.0:1789427794.630066:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579008 00000100:00100000:3.0:1789427794.630097:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789427794.630110:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1876350931578880:12345-192.168.202.24@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789427794.630200:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1789427794.630207:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1876350931579008:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789427794.630234:0:8401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 380d3950-14fb-41fe-b87d-b6d5bf049758@192.168.202.24@tcp t0 exp 0000000000000000 cur 139 last 0 00010000:00080000:3.0:1789427794.630256:0:8402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 380d3950-14fb-41fe-b87d-b6d5bf049758@192.168.202.24@tcp t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:0.0:1789427794.630275:0:8401:0:(genops.c:1384:class_connect()) connect: client 380d3950-14fb-41fe-b87d-b6d5bf049758, cookie 0x84fc867ede518419 00000020:00000080:3.0:1789427794.630280:0:8402:0:(genops.c:1384:class_connect()) connect: client 380d3950-14fb-41fe-b87d-b6d5bf049758, cookie 0x84fc867ede518420 00002000:00100000:0.0:1789427794.630290:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 380d3950-14fb-41fe-b87d-b6d5bf049758/ffff91958321e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789427794.630317:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789427794.630407:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789427794.630472:0:8401:0:(import.c:65:import_set_state_nolock()) ffff91958321d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427794.630543:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2393:x1876350931579008:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 335us (692us total) trans 0 rc 0/0 00002000:00100000:3.0:1789427794.630605:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 380d3950-14fb-41fe-b87d-b6d5bf049758/ffff919583ca9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789427794.630622:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789427794.630666:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789427794.630680:0:8402:0:(import.c:65:import_set_state_nolock()) ffff919583cac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427794.630701:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2393:x1876350931578880:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 595us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427794.630745:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789427794.630864:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789427794.631146:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579136 00000100:00100000:3.0:1789427794.631151:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579136 00000100:00100000:3.0:1789427794.631228:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:3.0:1789427794.631237:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931579136:12345-192.168.202.24@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789427794.631285:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931579136:12345-192.168.202.24@tcp:900:mount.lustre.0 Request processed in 50us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427794.631293:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789427794.633501:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427794.633881:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579264 00000100:00100000:2.0:1789427794.633890:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579264 00000100:00100000:2.0:1789427794.633949:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:2.0:1789427794.633958:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931579264:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789427794.634304:0:6485:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789427794.634394:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:8700:x1876350931579264:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 437us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.634402:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:0.0:1789427794.737050:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427794.737084:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940022912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427794.737178:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427794.737242:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940022912 00000100:00100000:3.0:1789427794.737258:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940022912 00000100:00100000:3.0:1789427794.737325:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789427794.737337:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940022912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427794.737400:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427794.738110:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940022912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 772us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427794.738120:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789427794.738200:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940022912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427795.249346:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940023424:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.249388:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940023296:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.249512:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427795.249564:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940023808:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.249585:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427795.249607:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940024320:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.249752:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.249871:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940023936:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.249934:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427795.249955:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940023168:0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.249998:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.250004:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940024448:0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250029:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940023680:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.250045:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427795.250062:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427795.250083:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940024192:0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250100:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427795.250131:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023424 00000100:00100000:2.0:1789427795.250137:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023424 00000100:00100000:2.0:1789427795.250175:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023168 00000100:00100000:2.0:1789427795.250178:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023168 00000100:00100000:2.0:1789427795.250201:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023680 00000100:00100000:2.0:1789427795.250204:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023680 00000100:00100000:2.0:1789427795.250223:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024192 00000100:00100000:2.0:1789427795.250225:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024192 00000100:00100000:2.0:1789427795.250238:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789427795.250245:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940023424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250287:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940023424:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.250293:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789427795.250308:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789427795.250312:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250337:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940023168:12345-0@lo:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.250343:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789427795.250361:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789427795.250366:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940023680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250389:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940023680:12345-0@lo:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.250395:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789427795.250404:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789427795.250408:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940024192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250447:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940024192:12345-0@lo:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.250452:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789427795.250481:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940023168:0@lo:400:kworker.0 00010000:00080000:2.0:1789427795.250492:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24700 x1876350940023680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427795.250515:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940023680:0@lo:400:kworker.0 00010000:00080000:2.0:1789427795.250525:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f8700 x1876350940024192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427795.250533:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940024192:0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.250556:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023808 00000100:00100000:2.0:1789427795.250559:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023808 00000100:00100000:2.0:1789427795.250578:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023936 00000100:00100000:2.0:1789427795.250580:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023936 00000100:00100000:2.0:1789427795.250589:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024448 00000100:00100000:2.0:1789427795.250592:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024448 00000100:00100000:2.0:1789427795.250602:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427795.250612:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940023808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.250663:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940023424:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.250683:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789427795.250690:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940023040:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.250725:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.251047:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940023552:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.251141:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.251165:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940024064:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.251190:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.251224:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789427795.251240:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940023936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.251259:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940023808:12345-0@lo:400:kworker.0 Request processed in 649us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.251269:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427795.251291:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427795.251298:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940024448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.251377:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940023936:12345-0@lo:400:kworker.0 Request processed in 140us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427795.251392:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789427795.251393:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.251453:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024320 00010000:00080000:0.0:1789427795.251455:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca27b80 x1876350940023808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427795.251463:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024320 00000100:00100000:0.0:1789427795.251470:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940023808:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.251499:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023296 00000100:00100000:0.0:1789427795.251504:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023296 00000100:00100000:0.0:1789427795.251531:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789427795.251537:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940023296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.251569:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940023296:12345-0@lo:400:kworker.0 Request processed in 31us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427795.251574:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789427795.251591:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427795.251595:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427795.251598:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427795.251620:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789427795.251633:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940024320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.251660:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940023296:0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.251691:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940024320:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00010000:00080000:0.0:1789427795.251695:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f8000 x1876350940024320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427795.251708:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427795.251722:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940024320:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.251765:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023552 00000100:00100000:0.0:1789427795.251769:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023552 00000100:00100000:0.0:1789427795.251789:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024064 00000100:00100000:0.0:1789427795.251797:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024064 00000100:00100000:0.0:1789427795.251812:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789427795.251818:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940023552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427795.251892:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427795.251935:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940024064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.252732:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940024448:12345-0@lo:400:kworker.0 Request processed in 1433us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.252740:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427795.252842:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940024576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427795.252872:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427795.252899:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024576 00000100:00100000:2.0:1789427795.252915:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024576 00000100:00100000:2.0:1789427795.252939:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427795.254227:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940024576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427795.254244:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427795.254280:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940024576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1335us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.254286:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789427795.254313:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df7100 x1876350940024576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427795.254327:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940024576:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789427795.254364:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427795.254374:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940023040 00000100:00100000:2.0:1789427795.254378:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940023040 00000100:00100000:2.0:1789427795.254400:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789427795.254406:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940023040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.254465:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940023040:12345-0@lo:400:kworker.0 Request processed in 58us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427795.254472:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789427795.254503:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940023552:12345-0@lo:400:kworker.0 Request processed in 2682us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427795.254514:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789427795.254522:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940023040:0@lo:400:kworker.0 00000100:00100000:2.0:1789427795.254536:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940023552:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.254564:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940024704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427795.254589:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427795.254623:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024704 00000100:00100000:0.0:1789427795.254626:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024704 00000100:00100000:0.0:1789427795.254654:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427795.254665:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940024704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427795.254676:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427795.254696:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940024064:12345-0@lo:400:kworker.0 Request processed in 2760us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427795.254708:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789427795.254732:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940024064:0@lo:400:kworker.0 00010000:00080000:2.0:1789427795.254751:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f9f80 x1876350940024448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427795.254761:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940024448:0@lo:400:kworker.0 00010000:00080000:2.0:1789427795.254772:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24a80 x1876350940023936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427795.254780:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940023936:0@lo:400:kworker.0 00000100:00100000:0.0:1789427795.254786:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940024704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427795.254795:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789427795.254923:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f8000 x1876350940024704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427795.254937:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940024704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789427795.377949:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427796.273578:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427796.273584:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940024960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427796.274037:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427796.274176:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024832 00000100:00100000:0.0:1789427796.274187:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024832 00000100:00100000:0.0:1789427796.274250:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427796.274259:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940024832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427796.274286:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427796.274335:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940024832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427796.274342:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789427796.274394:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f9c00 x1876350940024832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427796.274430:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427796.280981:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427796.281976:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940024960 00000100:00100000:0.0:1789427796.281986:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940024960 00000100:00100000:0.0:1789427796.282042:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427796.282054:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940024960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427796.282080:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427796.282146:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940024960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427796.282153:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789427796.282267:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958370aa00 x1876350940024960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427796.282289:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940024960:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427796.400660:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427797.297369:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427797.297389:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940025088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427797.297457:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427797.297725:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025088 00000100:00100000:0.0:1789427797.297734:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025088 00000100:00100000:0.0:1789427797.297795:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789427797.297806:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940025088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427797.297837:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789427797.297929:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940025088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427797.297968:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940025088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427797.297976:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:1.0:1789427797.424593:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427798.448629:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427799.472572:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427799.856610:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427799.856676:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427799.856721:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025216 00000100:00100000:2.0:1789427799.856730:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025216 00000100:00100000:2.0:1789427799.856776:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789427799.856785:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940025216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427799.856828:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427799.856885:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940025216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427799.856893:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789427799.856925:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427800.035404:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427800.035465:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427800.035495:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427800.035510:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579520 00000100:00100000:3.0:1789427800.035518:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579776 00000100:00100000:2.0:1789427800.035520:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579520 00000100:00100000:3.0:1789427800.035525:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579776 00000100:00100000:0.0:1789427800.035553:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427800.035572:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580032 00000100:00100000:1.0:1789427800.035579:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580032 00000100:00100000:0.0:1789427800.035585:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427800.035612:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579648 00000100:00100000:3.0:1789427800.035616:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579648 00000100:00100000:2.0:1789427800.035626:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:0.0:1789427800.035640:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427800.035641:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:2.0:1789427800.035643:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931579776:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427800.035649:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1789427800.035664:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931579520:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427800.035664:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931580032:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427800.035675:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427800.035703:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579392 00000100:00100000:0.0:1789427800.035708:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579392 00000100:00100000:2.0:1789427800.035734:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931579776:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.035737:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931579520:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.035743:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931580032:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427800.035745:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00100000:2.0:1789427800.035755:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:1.0:1789427800.035761:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1789427800.035762:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931579392:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427800.035767:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:2.0:1789427800.035777:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931579904 00000100:00100000:2.0:1789427800.035781:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931579904 00000100:00100000:1.0:1789427800.035790:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580160 00000100:00100000:3.0:1789427800.035794:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:1.0:1789427800.035796:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580160 00000100:00100000:0.0:1789427800.035802:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931579392:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.035808:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931579648:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427800.035810:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:0.0:1789427800.035816:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00100000:2.0:1789427800.035825:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931579904:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427800.035830:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1789427800.035840:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931580160:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427800.035846:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931579648:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.035853:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:2.0:1789427800.035876:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931579904:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427800.035888:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:1.0:1789427800.035893:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2395:x1876350931580160:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.035899:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00080000:3.0:1789427800.035922:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427800.035928:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427800.035932:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427800.035934:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427800.368608:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940025472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427800.368688:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427800.368725:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940025600:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.368739:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025472 00000100:00100000:1.0:1789427800.368740:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940025984:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.368747:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025472 00000100:00100000:0.0:1789427800.368771:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427800.368781:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427800.368812:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427800.368819:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940026112:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.368821:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940026496:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.368826:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940025472:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427800.368842:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940025344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427800.368871:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789427800.368874:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427800.368879:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427800.368900:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940027008:0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.368930:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427800.368950:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427800.368957:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940025472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.368964:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427800.368968:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940025856:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.368980:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940026624:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.368981:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025344 00000100:00100000:3.0:1789427800.368985:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025344 00010000:00080000:1.0:1789427800.368992:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f9500 x1876350940025472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427800.369008:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940025472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427800.369017:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427800.369018:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789427800.369027:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940025344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427800.369035:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789427800.369036:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427800.369061:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025600 00000100:00100000:2.0:1789427800.369066:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940026368:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369066:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025600 00000100:00100000:3.0:1789427800.369074:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940025344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427800.369075:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025856 00000100:00100000:3.0:1789427800.369080:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427800.369083:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025856 00000100:00080000:3.0:1789427800.369098:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427800.369099:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789427800.369109:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940025600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369117:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789427800.369130:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427800.369130:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940025856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369155:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940025600:12345-0@lo:400:kworker.0 Request processed in 47us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.369164:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789427800.369167:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940026880:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369183:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940025856:12345-0@lo:400:kworker.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427800.369191:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789427800.369205:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427800.369208:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025984 00000100:00100000:1.0:1789427800.369213:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025984 00000100:00100000:0.0:1789427800.369227:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026112 00000100:00100000:0.0:1789427800.369233:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026112 00010000:00080000:2.0:1789427800.369239:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca26300 x1876350940025344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427800.369249:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026624 00000100:00100000:2.0:1789427800.369252:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940025344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427800.369255:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026624 00000100:00100000:2.0:1789427800.369265:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940025856:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369279:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789427800.369283:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789427800.369288:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427800.369289:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940025984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.369295:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940025728:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369303:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940026112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369339:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940025984:12345-0@lo:400:kworker.0 Request processed in 53us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427800.369344:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427800.369349:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789427800.369354:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940026112:12345-0@lo:400:kworker.0 Request processed in 52us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427800.369363:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940025728 00000100:00100000:0.0:1789427800.369368:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940025728 00000100:00100000:2.0:1789427800.369374:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940026240:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369375:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427800.369398:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427800.369407:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789427800.369408:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427800.369410:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940026624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369439:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940025728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.369453:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940026752:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369476:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940026624:12345-0@lo:400:kworker.0 Request processed in 69us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427800.369486:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789427800.369492:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427800.369499:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940025728:12345-0@lo:400:kworker.0 Request processed in 62us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.369507:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427800.369507:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026240 00000100:00100000:0.0:1789427800.369513:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026240 00000100:00100000:2.0:1789427800.369526:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940025728:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369528:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026752 00000100:00100000:1.0:1789427800.369534:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026752 00000100:00100000:2.0:1789427800.369555:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026496 00000100:00100000:2.0:1789427800.369560:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026496 00000100:00100000:0.0:1789427800.369561:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789427800.369569:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789427800.369574:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940026240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369580:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.369592:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027008 00000100:00100000:2.0:1789427800.369595:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027008 00000100:00100000:3.0:1789427800.369599:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026368 00000100:00100000:2.0:1789427800.369614:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940026880 00000100:00100000:2.0:1789427800.369617:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026880 00000100:00100000:0.0:1789427800.369622:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940026240:12345-0@lo:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.369628:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940026752:12345-0@lo:400:kworker.0 Request processed in 50us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.369632:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940026368 00000100:00100000:2.0:1789427800.369635:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427800.369638:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789427800.369647:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789427800.369649:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940026496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369679:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427800.369687:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427800.369689:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940027008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.369695:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940026496:12345-0@lo:400:kworker.0 Request processed in 51us (824us total) trans 0 rc 0/0 00000001:00100000:3.0:1789427800.369701:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000100:00100000:0.0:1789427800.369701:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940026880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427800.369703:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789427800.369723:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940027008:12345-0@lo:400:kworker.0 Request processed in 36us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427800.369728:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000001:00100000:3.0:1789427800.369730:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00010000:00080000:2.0:1789427800.369747:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df5500 x1876350940026240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00100000:3.0:1789427800.369755:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000100:00100000:0.0:1789427800.369757:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940026880:12345-0@lo:400:kworker.0 Request processed in 58us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427800.369775:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940026240:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369776:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789427800.369797:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd72300 x1876350940026752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427800.369804:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427800.369814:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940026752:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.369817:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940026368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789427800.369825:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427800.369830:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427800.369834:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789427800.369836:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd71880 x1876350940026880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427800.369847:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940026880:0@lo:400:kworker.0 00000100:00100000:3.0:1789427800.369867:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940026368:12345-0@lo:400:kworker.0 Request processed in 40us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427800.369876:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789427800.369887:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940025600:0@lo:400:kworker.0 00010000:00080000:2.0:1789427800.369888:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4380 x1876350940026368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427800.369900:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940026368:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369912:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940026112:0@lo:400:kworker.0 00000100:00100000:0.0:1789427800.369926:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940026624:0@lo:400:kworker.0 00010000:00080000:1.0:1789427800.369961:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd70700 x1876350940027008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427800.369973:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940027008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427800.369984:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940025984:0@lo:400:kworker.0 00010000:00080000:1.0:1789427800.369993:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df7100 x1876350940026496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427800.370013:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940026496:0@lo:400:kworker.0 00000001:00100000:1.0:1789427800.370252:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00010000:00010000:1.0:1789427800.496671:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427800.714368:0:12149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789427801.393880:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427801.393964:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427801.394027:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427801.394089:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027136 00000100:00100000:1.0:1789427801.394096:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027136 00000100:00100000:1.0:1789427801.394235:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427801.394245:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940027136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427801.394274:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427801.394317:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940027136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427801.394323:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789427801.394362:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583709500 x1876350940027136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427801.394380:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427801.398442:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427801.398462:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940027264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427801.398520:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427801.398571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027264 00000100:00100000:1.0:1789427801.398577:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027264 00000100:00100000:1.0:1789427801.398617:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789427801.398625:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940027264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427801.398657:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427801.398697:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940027264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427801.398704:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789427801.398744:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583709500 x1876350940027264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427801.398762:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940027264:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427801.520887:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427802.416985:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427802.417007:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940027392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427802.417063:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427802.417193:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027392 00000100:00100000:2.0:1789427802.417201:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027392 00000100:00100000:2.0:1789427802.417259:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789427802.417269:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940027392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427802.417303:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427802.417366:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940027392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427802.417374:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789427802.417542:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940027392:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427802.548903:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427803.574022:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427804.592915:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427804.976684:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427804.976715:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940027520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427804.976801:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427804.977066:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027520 00000100:00100000:2.0:1789427804.977077:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027520 00000100:00100000:2.0:1789427804.977135:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789427804.977145:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940027520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427804.977188:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427804.977259:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940027520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427804.977267:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789427804.977475:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940027520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427805.157859:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427805.157901:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427805.157923:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427805.157949:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427805.158017:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427805.158049:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580544 00000100:00100000:2.0:1789427805.158057:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580544 00000100:00100000:2.0:1789427805.158106:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580800 00000100:00100000:2.0:1789427805.158109:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580800 00000100:00100000:2.0:1789427805.158123:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580416 00000100:00100000:2.0:1789427805.158125:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580416 00000100:00100000:2.0:1789427805.158140:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:2.0:1789427805.158149:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931580544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427805.158216:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931580544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 66us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.158224:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:2.0:1789427805.158239:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:2.0:1789427805.158245:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580800:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427805.158265:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580800:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.158271:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:2.0:1789427805.158280:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:2.0:1789427805.158286:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931580416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427805.158334:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931580416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.158341:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:3.0:1789427805.158458:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580288 00000100:00100000:3.0:1789427805.158462:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580288 00000100:00100000:3.0:1789427805.158488:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 290 00000100:00100000:3.0:1789427805.158495:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931580288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427805.158519:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931580288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.158525:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 290 00000100:00080000:3.0:1789427805.158577:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427805.158601:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427805.160357:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427805.160401:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427805.160458:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580672 00000100:00100000:3.0:1789427805.160469:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580672 00000100:00100000:3.0:1789427805.160546:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:3.0:1789427805.160556:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580672:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427805.160639:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580672:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.160647:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:3.0:1789427805.160677:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581056 00000100:00100000:3.0:1789427805.160681:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581056 00000100:00100000:2.0:1789427805.166169:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931580928 00000100:00100000:2.0:1789427805.166186:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931580928 00000100:00100000:3.0:1789427805.166370:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1789427805.166385:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931581056:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427805.166492:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931581056:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 112us (8542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.166517:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1789427805.168969:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1789427805.168996:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580928:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427805.169092:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931580928:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 108us (8689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.172047:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00080000:1.0:1789427805.179533:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427805.179541:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427805.179545:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427805.488996:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427805.489026:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940027648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427805.489129:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427805.489188:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027648 00000100:00100000:0.0:1789427805.489199:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027648 00000100:00080000:2.0:1789427805.489244:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427805.489283:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427805.489297:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940027648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427805.489334:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427805.489396:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940027648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.489404:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789427805.489554:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df6680 x1876350940027648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427805.489579:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940027648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427805.489903:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940027904:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.489947:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.489979:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940028032:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.489981:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940028416:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490007:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.490022:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940028544:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490059:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427805.490059:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.490081:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940029056:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.490092:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940028928:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490107:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427805.490127:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.490140:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427805.490149:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940028160:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.490152:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789427805.490161:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940027776:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490178:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427805.490201:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.490204:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940028672:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490230:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427805.490236:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940028288:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490255:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028544 00000100:00100000:2.0:1789427805.490259:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028544 00000100:00100000:3.0:1789427805.490300:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027904 00000100:00100000:3.0:1789427805.490307:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027904 00000100:00100000:2.0:1789427805.490312:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029056 00000100:00100000:2.0:1789427805.490318:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029056 00000100:00100000:2.0:1789427805.490341:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028672 00000100:00100000:2.0:1789427805.490344:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028672 00000100:00100000:3.0:1789427805.490345:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028416 00000100:00100000:3.0:1789427805.490350:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028416 00000100:00100000:2.0:1789427805.490360:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427805.490368:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940028544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.490377:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028928 00000100:00100000:3.0:1789427805.490381:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028928 00000100:00100000:3.0:1789427805.490403:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028160 00000100:00100000:3.0:1789427805.490406:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028160 00000100:00100000:2.0:1789427805.490408:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940028544:12345-0@lo:400:kworker.0 Request processed in 41us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.490437:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427805.490453:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427805.490461:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940029056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.490486:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789427805.490497:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940029056:12345-0@lo:400:kworker.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.490498:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940027904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490511:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427805.490528:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427805.490536:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.490587:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.490596:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940028672:12345-0@lo:400:kworker.0 Request processed in 61us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.490605:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940027904:12345-0@lo:400:kworker.0 Request processed in 109us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.490608:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940028800:0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490610:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789427805.490622:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789427805.490636:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427805.490642:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028288 00000100:00100000:3.0:1789427805.490648:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028288 00000100:00100000:2.0:1789427805.490648:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028800 00000100:00100000:2.0:1789427805.490654:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028800 00000100:00100000:0.0:1789427805.490659:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940027904:0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.490678:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789427805.490689:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940028416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.490693:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940028032 00000100:00100000:2.0:1789427805.490698:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789427805.490700:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940028032 00000100:00100000:2.0:1789427805.490710:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940028928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.490738:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940028416:12345-0@lo:400:kworker.0 Request processed in 52us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.490743:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789427805.490750:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789427805.490757:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940028032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490762:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940028928:12345-0@lo:400:kworker.0 Request processed in 53us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.490772:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789427805.490784:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427805.490799:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940028160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427805.490799:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789427805.490800:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940028032:12345-0@lo:400:kworker.0 Request processed in 48us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.490833:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789427805.490838:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940028288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.490858:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940028160:12345-0@lo:400:kworker.0 Request processed in 65us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.490866:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789427805.490879:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940028288:12345-0@lo:400:kworker.0 Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.490909:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427805.490917:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789427805.490921:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940028800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789427805.490940:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427805.490946:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427805.490950:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427805.490953:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427805.490960:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940028800:12345-0@lo:400:kworker.0 Request processed in 43us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427805.490968:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427805.490981:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940027776 00000100:00100000:2.0:1789427805.490986:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940027776 00000100:00100000:0.0:1789427805.491007:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427805.491014:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789427805.491019:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940027776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.491049:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427805.491054:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940027776:12345-0@lo:400:kworker.0 Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427805.491059:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789427805.491099:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029184 00000100:00100000:0.0:1789427805.491104:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029184 00000100:00100000:0.0:1789427805.491130:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427805.491138:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427805.491154:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427805.491169:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940028160:0@lo:400:kworker.0 00010000:00080000:3.0:1789427805.491188:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6300 x1876350940028672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427805.491199:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427805.491204:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940028672:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.491215:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789427805.491218:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940028032:0@lo:400:kworker.0 00010000:00080000:3.0:1789427805.491232:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5c00 x1876350940028544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427805.491242:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940027776:0@lo:400:kworker.0 00000100:00100000:3.0:1789427805.491245:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940028544:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.491254:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940028288:0@lo:400:kworker.0 00010000:00080000:3.0:1789427805.491265:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5180 x1876350940029056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427805.491268:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940028800:0@lo:400:kworker.0 00010000:00080000:0.0:1789427805.491281:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f7480 x1876350940028416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427805.491283:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940029056:0@lo:400:kworker.0 00000100:00100000:0.0:1789427805.491297:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940028416:0@lo:400:kworker.0 00010000:00080000:0.0:1789427805.491307:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6680 x1876350940028928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427805.491316:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940028928:0@lo:400:kworker.0 00010000:00080000:2.0:1789427805.491574:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd72300 x1876350940029184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427805.491585:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940029184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427805.616720:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789427805.979680:0:12464:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789427805.980020:0:12464:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789427806.512887:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427806.512910:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940029312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427806.512977:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427806.513452:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940029440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427806.513485:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427806.513571:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029312 00000100:00100000:0.0:1789427806.513579:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029312 00000100:00100000:0.0:1789427806.513637:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029440 00000100:00100000:0.0:1789427806.513641:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029440 00000100:00100000:0.0:1789427806.513657:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789427806.513665:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940029312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427806.513694:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427806.513753:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940029312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427806.513760:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789427806.513776:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789427806.513783:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940029440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427806.513821:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427806.513848:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940029440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427806.513866:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789427806.513899:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fd500 x1876350940029440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427806.513918:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940029440:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789427806.513929:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583709500 x1876350940029312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427806.513941:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940029312:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427806.640656:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427807.539029:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940029568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427807.539097:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427807.539632:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029568 00000100:00100000:0.0:1789427807.539643:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029568 00000100:00100000:0.0:1789427807.539696:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789427807.539706:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940029568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427807.539738:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427807.539809:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940029568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427807.539815:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427807.539945:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940029568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427807.672376:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427808.043659:0:12561:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427808.043876:0:12561:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789427808.692233:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427809.712689:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789427809.967170:0:12660:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789427809.969078:0:12660:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789427810.097867:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427810.097901:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940029696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427810.097983:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.098055:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029696 00000100:00100000:2.0:1789427810.098064:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029696 00000100:00100000:2.0:1789427810.098116:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427810.098127:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940029696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427810.098171:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427810.098223:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940029696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.098230:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427810.098285:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940029696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427810.277907:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.277958:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.277987:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.278011:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.278029:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.278054:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.278119:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427810.278160:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581312 00000100:00100000:2.0:1789427810.278171:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581312 00000100:00100000:2.0:1789427810.278338:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581440 00000100:00100000:2.0:1789427810.278342:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581440 00000100:00100000:2.0:1789427810.278361:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581568 00000100:00100000:2.0:1789427810.278364:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581568 00000100:00100000:2.0:1789427810.278378:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581696 00000100:00100000:2.0:1789427810.278380:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581696 00000100:00100000:2.0:1789427810.278400:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:2.0:1789427810.278412:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931581312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427810.278459:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581184 00000100:00100000:3.0:1789427810.278476:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581184 00000100:00100000:3.0:1789427810.278514:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 292 00000100:00100000:3.0:1789427810.278522:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931581184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427810.278544:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931581312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 132us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.278555:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931581184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.278556:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:3.0:1789427810.278576:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 292 00000100:00100000:2.0:1789427810.278582:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:2.0:1789427810.278592:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931581440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427810.278619:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:2.0:1789427810.278625:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931581440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.278633:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581568:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427810.278636:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:2.0:1789427810.278657:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:2.0:1789427810.278666:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581696:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427810.278669:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581568:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 39us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.278678:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:2.0:1789427810.278702:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581696:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.278709:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:2.0:1789427810.278743:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581824 00000100:00100000:2.0:1789427810.278747:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581824 00000100:00100000:2.0:1789427810.278788:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931581952 00000100:00100000:2.0:1789427810.278792:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931581952 00000100:00100000:2.0:1789427810.278817:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:2.0:1789427810.278825:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427810.278838:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:3.0:1789427810.278848:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581952:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427810.278865:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 40us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.278873:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1789427810.278878:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931581952:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.278886:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00080000:2.0:1789427810.278899:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427810.278905:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427810.278908:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427810.278917:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427810.608830:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940029824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427810.608908:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427810.608924:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940030208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427810.608969:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427810.609000:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029824 00000100:00100000:0.0:1789427810.609009:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029824 00000100:00100000:3.0:1789427810.609061:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940029952:0@lo:400:kworker.0 00000100:00100000:0.0:1789427810.609084:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789427810.609094:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940029824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427810.609115:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789427810.609150:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427810.609151:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427810.609156:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940030080:0@lo:400:kworker.0 00000100:00100000:3.0:1789427810.609192:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427810.609194:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940029824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427810.609202:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789427810.609243:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030080 00000100:00100000:0.0:1789427810.609247:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030080 00010000:00080000:3.0:1789427810.609253:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd72300 x1876350940029824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427810.609275:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789427810.609281:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427810.609283:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940029824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427810.609319:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940030080:12345-0@lo:400:kworker.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427810.609326:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789427810.609345:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940029952 00000100:00100000:3.0:1789427810.609348:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940030080:0@lo:400:kworker.0 00000100:00100000:0.0:1789427810.609349:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940029952 00000100:00100000:0.0:1789427810.609373:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789427810.609379:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940029952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427810.609445:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940029952:12345-0@lo:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427810.609452:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789427810.609483:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427810.609508:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030208 00000100:00100000:0.0:1789427810.609512:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030208 00000100:00100000:0.0:1789427810.609536:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789427810.609542:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940030208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427810.609551:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427810.609580:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940030208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427810.609587:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789427810.609618:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fc380 x1876350940030208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427810.609631:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940030208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427810.609636:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940029952:0@lo:400:kworker.0 00000100:00080000:0.0:1789427810.609663:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427810.612316:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940030336:0@lo:400:kworker.0 00000100:00100000:0.0:1789427810.612402:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427810.612857:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940030464:0@lo:400:kworker.0 00000100:00100000:1.0:1789427810.612896:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427810.613011:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030464 00000100:00100000:0.0:1789427810.613021:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030464 00000100:00100000:0.0:1789427810.613077:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789427810.613087:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427810.620837:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030336 00000100:00100000:3.0:1789427810.620860:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030336 00000100:00100000:2.0:1789427810.620893:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940030592:0@lo:400:kworker.0 00000100:00100000:3.0:1789427810.620933:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427810.620943:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940030336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.620982:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427810.621016:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940030336:12345-0@lo:400:kworker.0 Request processed in 74us (8615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.621023:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427810.621039:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030592 00000100:00100000:3.0:1789427810.621043:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030592 00000100:00100000:3.0:1789427810.621068:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427810.621075:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940030592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621102:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940030720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427810.621103:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940030592:12345-0@lo:400:kworker.0 Request processed in 30us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427810.621109:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789427810.621134:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.621168:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030720 00000100:00100000:2.0:1789427810.621172:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030720 00000100:00100000:2.0:1789427810.621213:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789427810.621221:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940030720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621256:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940030720:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.621263:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789427810.621305:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940030720:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621332:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940030592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621369:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427810.621375:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940030848:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621396:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.621443:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427810.621448:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940030976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621494:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.621519:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030976 00000100:00100000:2.0:1789427810.621522:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030976 00000100:00100000:2.0:1789427810.621548:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427810.621554:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621583:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940030976:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.621598:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789427810.621624:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcbbea00 x1876350940030976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427810.621636:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940030976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621660:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940031104:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621679:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.621701:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031104 00000100:00100000:2.0:1789427810.621704:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031104 00000100:00100000:2.0:1789427810.621726:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789427810.621731:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621759:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940031104:12345-0@lo:400:kworker.0 Request processed in 27us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.621776:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789427810.621800:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ae88e300 x1876350940031104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427810.621809:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940031104:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621833:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940031232:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621853:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.621871:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940030848 00000100:00100000:2.0:1789427810.621874:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940030848 00000100:00100000:2.0:1789427810.621887:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031232 00000100:00100000:2.0:1789427810.621889:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031232 00000100:00100000:2.0:1789427810.621901:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789427810.621906:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621932:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940030848:12345-0@lo:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.621944:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789427810.621954:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789427810.621959:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940031232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.621980:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940031232:12345-0@lo:400:kworker.0 Request processed in 21us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.621985:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789427810.622005:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940031232:0@lo:400:kworker.0 00010000:00080000:2.0:1789427810.622015:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcbbdf80 x1876350940030848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427810.622024:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940030848:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.622049:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427810.622054:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940031360:0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.622073:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427810.622088:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031360 00000100:00100000:2.0:1789427810.622090:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031360 00000100:00100000:2.0:1789427810.622104:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789427810.622109:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940031360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427810.622136:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940031360:12345-0@lo:400:kworker.0 Request processed in 26us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427810.622141:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1789427810.622159:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ae88e300 x1876350940031360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427810.622168:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940031360:0@lo:400:kworker.0 00000100:00080000:3.0:1789427810.632486:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427810.632501:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427810.632505:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427810.632574:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940030336:0@lo:400:kworker.0 00000100:00100000:0.0:1789427810.634070:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940030464:12345-0@lo:400:kworker.0 Request processed in 20976us (21165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427810.634086:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789427810.634591:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940030464:0@lo:400:kworker.0 00010000:00010000:3.0:1789427810.738522:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427811.632839:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940031488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427811.632911:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427811.632984:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427811.632992:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940031616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427811.633015:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427811.633134:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031488 00000100:00100000:1.0:1789427811.633156:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031488 00000100:00100000:1.0:1789427811.633222:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031616 00000100:00100000:1.0:1789427811.633226:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031616 00000100:00100000:1.0:1789427811.633242:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427811.633250:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940031488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427811.633278:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427811.633324:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940031488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427811.633330:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427811.633349:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427811.633355:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940031616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427811.633366:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427811.633392:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940031616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427811.633398:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789427811.633451:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583709500 x1876350940031616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427811.633469:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940031616:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789427811.633490:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fc000 x1876350940031488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427811.633501:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940031488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427811.763130:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427812.657184:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940031744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427812.657279:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427812.664008:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031744 00000100:00100000:3.0:1789427812.664038:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031744 00000100:00100000:3.0:1789427812.664104:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789427812.664114:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940031744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427812.664152:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427812.668577:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940031744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4458us (11290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427812.668589:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789427812.668710:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940031744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427812.788063:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789427813.039645:0:12757:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789427813.039937:0:12757:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789427813.808641:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427814.834379:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789427815.210977:0:12854:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789427815.211181:0:12854:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789427815.217744:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427815.217766:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940031872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427815.217839:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.217974:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940031872 00000100:00100000:2.0:1789427815.217981:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940031872 00000100:00100000:2.0:1789427815.218027:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789427815.218037:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940031872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427815.218069:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427815.218117:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940031872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.218125:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789427815.218166:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940031872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427815.412565:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427815.412607:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427815.412631:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427815.412738:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427815.412758:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427815.412874:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582080 00000100:00100000:0.0:1789427815.412884:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582080 00000100:00100000:0.0:1789427815.412936:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 294 00000100:00100000:0.0:1789427815.412946:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931582080:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427815.413011:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931582080:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 67us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.413018:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 294 00000100:00100000:0.0:1789427815.413050:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582336 00000100:00100000:0.0:1789427815.413054:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582336 00000100:00100000:0.0:1789427815.413093:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582592 00000100:00100000:0.0:1789427815.413096:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582592 00000100:00100000:0.0:1789427815.413107:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582208 00000100:00100000:0.0:1789427815.413110:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582208 00000100:00100000:0.0:1789427815.413121:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582464 00000100:00100000:0.0:1789427815.413123:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582464 00000100:00100000:0.0:1789427815.413139:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1789427815.413145:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931582336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427815.413173:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931582336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.413179:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1789427815.413192:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:0.0:1789427815.413198:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931582592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427815.413218:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931582592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.413223:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:0.0:1789427815.413235:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:0.0:1789427815.413241:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931582208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427815.413261:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931582208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 20us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.413267:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:0.0:1789427815.413278:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:0.0:1789427815.413284:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931582464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427815.413302:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931582464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 19us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427815.413574:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00080000:3.0:1789427815.414026:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427815.414030:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427815.414063:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427815.416006:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:0.0:1789427815.416079:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582720 00000100:00100000:0.0:1789427815.416086:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582720 00000100:00100000:0.0:1789427815.416132:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582848 00000100:00100000:0.0:1789427815.416136:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582848 00000100:00100000:0.0:1789427815.416157:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789427815.416165:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2393:x1876350931582720:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:0.0:1789427815.416190:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518420 00000100:00080000:0.0:1789427815.416199:0:8400:0:(import.c:65:import_set_state_nolock()) ffff919583cac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789427815.416246:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789427815.416384:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+2:2393:x1876350931582720:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 219us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.416392:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789427815.416405:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789427815.416429:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2393:x1876350931582848:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:0.0:1789427815.416441:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518419 00000100:00080000:0.0:1789427815.416451:0:8400:0:(import.c:65:import_set_state_nolock()) ffff91958321d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789427815.416475:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789427815.416541:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+2:2393:x1876350931582848:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 128us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.416547:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00010000:00010000:0.0:1789427815.416572:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427815.416577:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427815.422704:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427815.422714:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427815.729338:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940032128:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729399:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729463:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940032640:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729485:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729523:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940033152:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729544:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729573:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789427815.729579:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940032000:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729620:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940032512:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729651:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729683:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940033024:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729705:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729733:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940033536:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729753:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729784:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940032256:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729805:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729821:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940032768:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729837:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729853:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729871:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729888:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789427815.729894:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940032384:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729912:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729922:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940032896:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729940:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729956:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940033408:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.729972:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427815.729997:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032128 00000100:00100000:2.0:1789427815.730004:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032128 00000100:00100000:2.0:1789427815.730035:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032640 00000100:00100000:2.0:1789427815.730038:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032640 00000100:00100000:2.0:1789427815.730057:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033152 00000100:00100000:2.0:1789427815.730059:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033152 00000100:00100000:2.0:1789427815.730068:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032768 00000100:00100000:2.0:1789427815.730070:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032768 00000100:00100000:2.0:1789427815.730089:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033280 00000100:00100000:2.0:1789427815.730091:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033280 00000100:00100000:2.0:1789427815.730103:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032384 00000100:00100000:2.0:1789427815.730105:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032384 00000100:00100000:2.0:1789427815.730117:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427815.730125:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940032128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730176:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940032128:12345-0@lo:400:kworker.0 Request processed in 50us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730183:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427815.730200:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789427815.730205:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940032640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730228:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940032640:12345-0@lo:400:kworker.0 Request processed in 24us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730233:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789427815.730244:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789427815.730249:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940033152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730270:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940033152:12345-0@lo:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730274:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789427815.730284:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789427815.730289:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940032768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730319:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940032768:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730325:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789427815.730336:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789427815.730342:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940033280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730378:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940033280:12345-0@lo:400:kworker.0 Request processed in 36us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730384:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789427815.730396:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789427815.730401:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940032384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730458:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940032384:12345-0@lo:400:kworker.0 Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730464:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789427815.730487:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032000 00000100:00100000:2.0:1789427815.730491:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032000 00000100:00100000:2.0:1789427815.730511:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789427815.730516:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940032000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730541:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940032000:12345-0@lo:400:kworker.0 Request processed in 25us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730546:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789427815.730568:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032512 00000100:00100000:2.0:1789427815.730572:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032512 00000100:00100000:2.0:1789427815.730593:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032256 00000100:00100000:2.0:1789427815.730596:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032256 00000100:00100000:2.0:1789427815.730609:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789427815.730614:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940032512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730644:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940032512:12345-0@lo:400:kworker.0 Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730650:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789427815.730661:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789427815.730667:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940032256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730699:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940032256:12345-0@lo:400:kworker.0 Request processed in 33us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730705:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789427815.730731:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033024 00000100:00100000:2.0:1789427815.730735:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033024 00000100:00100000:2.0:1789427815.730750:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033536 00000100:00100000:2.0:1789427815.730752:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033536 00000100:00100000:2.0:1789427815.730761:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940032896 00000100:00100000:2.0:1789427815.730763:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940032896 00000100:00100000:2.0:1789427815.730772:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033408 00000100:00100000:2.0:1789427815.730774:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033408 00000100:00100000:2.0:1789427815.730783:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789427815.730789:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940033024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730813:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940033024:12345-0@lo:400:kworker.0 Request processed in 25us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730819:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789427815.730827:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789427815.730832:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730855:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940033536:12345-0@lo:400:kworker.0 Request processed in 23us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730861:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789427815.730870:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427815.730875:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940032896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730895:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940032896:12345-0@lo:400:kworker.0 Request processed in 21us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730900:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427815.730908:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789427815.730919:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940033408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.730941:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940033408:12345-0@lo:400:kworker.0 Request processed in 23us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427815.730946:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789427815.730976:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427815.730979:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427815.730982:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427815.730984:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427815.731009:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940032384:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731020:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fce00 x1876350940032896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731030:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940032896:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731038:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fd500 x1876350940033408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731046:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940033408:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731054:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940032256:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731062:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fd180 x1876350940032768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731069:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940032768:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731077:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fc000 x1876350940033280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731084:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731110:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940032000:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731125:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940032512:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731133:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fed80 x1876350940033024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731140:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940033024:0@lo:400:kworker.0 00010000:00080000:2.0:1789427815.731148:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df6680 x1876350940033536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427815.731156:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940033536:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731162:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940032128:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731170:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940032640:0@lo:400:kworker.0 00000100:00100000:2.0:1789427815.731177:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940033152:0@lo:400:kworker.0 00000100:00100000:1.0:1789427815.731701:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427815.731709:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940033664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427815.731747:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427815.731913:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033664 00000100:00100000:0.0:1789427815.731917:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033664 00000100:00100000:0.0:1789427815.731952:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427815.731966:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940033664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427815.731986:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427815.732021:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940033664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.732027:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427815.732527:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427815.732535:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940033792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427815.732556:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427815.732576:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033792 00000100:00100000:0.0:1789427815.732579:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033792 00000100:00100000:0.0:1789427815.732595:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789427815.732601:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940033792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427815.732609:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427815.732631:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940033792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427815.732636:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789427815.732666:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4e00 x1876350940033792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427815.732679:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940033792:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789427815.732932:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539c00 x1876350940033664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427815.732944:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940033664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789427815.856762:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427816.755627:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940033920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427816.755691:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427816.755766:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940033920 00000100:00100000:1.0:1789427816.755774:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940033920 00000100:00100000:1.0:1789427816.755814:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789427816.755823:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940033920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427816.755850:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427816.755892:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940033920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427816.755899:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789427816.755935:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539c00 x1876350940033920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427816.755953:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940033920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427816.760006:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427816.760061:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427816.760111:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034048 00000100:00100000:3.0:1789427816.760116:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034048 00000100:00100000:3.0:1789427816.760146:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789427816.760154:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940034048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427816.760171:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427816.760203:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940034048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427816.760209:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789427816.760242:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9195831bc380 x1876350940034048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427816.760258:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940034048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427816.887400:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427817.776713:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427817.776736:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940034176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427817.776804:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427817.776969:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034176 00000100:00100000:0.0:1789427817.776978:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034176 00000100:00100000:0.0:1789427817.777028:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789427817.777037:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940034176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427817.777069:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427817.777127:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940034176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427817.777143:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789427817.777411:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940034176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427817.907169:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427818.928746:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427819.639569:0:12999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789427819.952652:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427820.337577:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427820.337601:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940034304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427820.337668:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427820.337762:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034304 00000100:00100000:2.0:1789427820.337770:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034304 00000100:00100000:2.0:1789427820.337823:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789427820.337832:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940034304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427820.337865:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427820.337923:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940034304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427820.337931:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789427820.338484:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940034304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427820.517706:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427820.517748:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427820.517813:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931582976 00000100:00100000:0.0:1789427820.517824:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931582976 00000100:00100000:3.0:1789427820.517831:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427820.517890:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:0.0:1789427820.517902:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931582976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427820.517973:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931582976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.517980:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:3.0:1789427820.518737:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427820.519345:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583104 00000100:00100000:2.0:1789427820.519352:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583104 00000100:00100000:2.0:1789427820.519488:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583360 00000100:00100000:2.0:1789427820.519492:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583360 00000100:00080000:1.0:1789427820.519544:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427820.519575:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:1.0:1789427820.519587:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931583104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427820.519643:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931583104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 60us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427820.519651:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:2.0:1789427820.519822:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:2.0:1789427820.519843:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931583360:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427820.519892:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931583360:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 50us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427820.519898:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:3.0:1789427820.526918:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427820.532444:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583232 00000100:00100000:1.0:1789427820.532460:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583232 00000100:00080000:3.0:1789427820.532636:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427820.533393:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583488 00000100:00100000:1.0:1789427820.533401:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583488 00000100:00100000:1.0:1789427820.533479:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:1.0:1789427820.533491:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931583232:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427820.533578:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931583232:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 90us (14847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427820.533587:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:1.0:1789427820.533607:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:1.0:1789427820.533614:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931583488:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427820.533641:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931583488:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (6732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427820.533647:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00080000:3.0:1789427820.533838:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427820.848851:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940034688:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.848920:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.848967:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940035200:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.848992:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.849009:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940035712:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849028:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.849048:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789427820.849053:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940034560:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849073:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.849087:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940035072:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849105:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.849127:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940035584:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849144:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427820.849177:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035200 00000100:00100000:0.0:1789427820.849191:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035200 00000100:00100000:0.0:1789427820.849234:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035712 00000100:00100000:0.0:1789427820.849237:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035712 00000100:00100000:0.0:1789427820.849248:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034560 00000100:00100000:0.0:1789427820.849251:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034560 00000100:00100000:0.0:1789427820.849262:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035072 00000100:00100000:0.0:1789427820.849264:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035072 00000100:00100000:0.0:1789427820.849279:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035584 00000100:00100000:0.0:1789427820.849282:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035584 00000100:00100000:0.0:1789427820.849296:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789427820.849304:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940035200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849371:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940035200:12345-0@lo:400:kworker.0 Request processed in 66us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.849377:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789427820.849395:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789427820.849401:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940035712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849456:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940035712:12345-0@lo:400:kworker.0 Request processed in 55us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.849462:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789427820.849474:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789427820.849479:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940034560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849505:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940034560:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.849511:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789427820.849523:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789427820.849528:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940035072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849553:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940035072:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.849568:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789427820.849581:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789427820.849587:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940035584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849614:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940035584:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427820.849619:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789427820.849660:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940034560:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849685:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940035072:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.849694:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940035584:0@lo:400:kworker.0 00010000:00080000:0.0:1789427820.849705:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb100 x1876350940035200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427820.849714:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940035200:0@lo:400:kworker.0 00010000:00080000:0.0:1789427820.849723:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cb9c00 x1876350940035712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427820.849732:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940035712:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.849958:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940034432:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.849994:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850023:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940034944:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850044:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850065:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940035456:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850085:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850101:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940035968:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850121:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850139:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789427820.850144:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940034816:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850166:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850182:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940035328:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850202:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850228:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940035840:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850251:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.850275:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940036096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427820.850298:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789427820.850324:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427820.850329:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427820.850339:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034432 00000100:00100000:3.0:1789427820.850344:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034432 00000100:00100000:3.0:1789427820.850376:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789427820.850383:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850441:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940034432:12345-0@lo:400:kworker.0 Request processed in 59us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850447:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789427820.850476:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034688 00000100:00100000:3.0:1789427820.850480:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034688 00000100:00100000:3.0:1789427820.850500:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034944 00000100:00100000:3.0:1789427820.850502:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034944 00000100:00100000:3.0:1789427820.850514:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789427820.850520:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940034688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850552:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940034688:12345-0@lo:400:kworker.0 Request processed in 32us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850557:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789427820.850569:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789427820.850577:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850602:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940034944:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850607:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789427820.850633:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035456 00000100:00100000:3.0:1789427820.850637:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035456 00000100:00100000:3.0:1789427820.850660:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035968 00000100:00100000:3.0:1789427820.850663:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035968 00000100:00100000:3.0:1789427820.850689:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035328 00000100:00100000:3.0:1789427820.850691:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035328 00000100:00100000:3.0:1789427820.850703:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940035840 00000100:00100000:3.0:1789427820.850706:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940035840 00000100:00100000:3.0:1789427820.850718:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789427820.850723:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940035456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850754:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940035456:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850759:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789427820.850769:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789427820.850775:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940035968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850892:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940035968:12345-0@lo:400:kworker.0 Request processed in 116us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850898:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789427820.850910:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789427820.850915:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940035328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850939:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940035328:12345-0@lo:400:kworker.0 Request processed in 24us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.850944:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789427820.850956:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789427820.850963:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940035840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.850986:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940035840:12345-0@lo:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.851000:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789427820.851030:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427820.851033:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789427820.851055:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb800 x1876350940035328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427820.851068:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940035328:0@lo:400:kworker.0 00010000:00080000:3.0:1789427820.851077:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbaa00 x1876350940035840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427820.851084:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940035840:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.851094:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940034432:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.851103:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940034944:0@lo:400:kworker.0 00010000:00080000:3.0:1789427820.851112:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940035456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427820.851119:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940035456:0@lo:400:kworker.0 00010000:00080000:3.0:1789427820.851128:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cba300 x1876350940035968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427820.851136:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940035968:0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.851166:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940034816 00000100:00100000:3.0:1789427820.851169:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940034816 00000100:00100000:3.0:1789427820.851192:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789427820.851199:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940034816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427820.851231:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940034816:12345-0@lo:400:kworker.0 Request processed in 32us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.851244:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789427820.851269:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940034816:0@lo:400:kworker.0 00000100:00100000:1.0:1789427820.851502:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036096 00000100:00100000:1.0:1789427820.851507:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036096 00000100:00100000:1.0:1789427820.851538:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789427820.851545:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940036096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427820.851568:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427820.851609:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940036096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427820.851621:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789427820.851659:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca2bb80 x1876350940036096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427820.851686:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940036096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427820.851785:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940034688:0@lo:400:kworker.0 00000100:00100000:0.0:1789427820.853606:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940036224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427820.853682:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427820.853914:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036224 00000100:00100000:3.0:1789427820.853924:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036224 00000100:00100000:3.0:1789427820.853973:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789427820.853982:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940036224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427820.854002:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427820.854051:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940036224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427820.854057:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789427820.854096:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad92a680 x1876350940036224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427820.854114:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940036224:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789427820.978847:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789427821.366265:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000020:00000080:2.0:1789427821.366278:0:9478:0:(genops.c:885:class_export_put()) final put ffff91958321e000/380d3950-14fb-41fe-b87d-b6d5bf049758 00000020:00000080:1.0:1789427821.366393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91958321e000/380d3950-14fb-41fe-b87d-b6d5bf049758 for lustre-OST0001 00000020:00000080:1.0:1789427821.366485:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91958321d000 for lustre-OST0001 00000001:00100000:1.0:1789427821.371913:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000020:00000080:1.0:1789427821.371923:0:8395:0:(genops.c:885:class_export_put()) final put ffff919583ca9800/380d3950-14fb-41fe-b87d-b6d5bf049758 00000020:00000080:3.0:1789427821.373892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583ca9800/380d3950-14fb-41fe-b87d-b6d5bf049758 for lustre-OST0000 00000020:00000080:2.0:1789427821.374038:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583cac000 for lustre-OST0000 00000100:00100000:1.0:1789427821.872581:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427821.872604:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427821.872681:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427821.872743:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036352 00000100:00100000:1.0:1789427821.872750:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036352 00000100:00100000:1.0:1789427821.872810:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789427821.872820:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940036352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427821.872848:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427821.872890:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940036352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427821.872896:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789427821.872940:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539c00 x1876350940036352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427821.872959:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427821.873483:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940036480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427821.873518:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427821.875805:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036480 00000100:00100000:0.0:1789427821.875821:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036480 00000100:00100000:0.0:1789427821.875925:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789427821.875936:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940036480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427821.875968:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427821.876054:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940036480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427821.876061:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789427821.876133:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad92a680 x1876350940036480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427821.876155:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940036480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427822.001639:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427822.897069:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427822.897762:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940036608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427822.897824:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427822.898164:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036608 00000100:00100000:2.0:1789427822.898172:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036608 00000100:00100000:1.0:1789427822.898406:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427822.898441:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940036608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427822.898484:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789427822.898602:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940036608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427822.898610:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789427822.898630:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940036608:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427823.024625:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427824.048668:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427825.072556:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427825.456637:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940036736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427825.456721:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427825.456768:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036736 00000100:00100000:1.0:1789427825.456776:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036736 00000100:00100000:1.0:1789427825.456831:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427825.456839:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940036736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427825.456865:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427825.456926:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940036736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427825.456932:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789427825.456986:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940036736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427825.635179:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427825.635230:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427825.635251:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583744 00000100:00100000:2.0:1789427825.635259:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427825.635265:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583744 00000100:00100000:2.0:1789427825.635295:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427825.635296:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583616 00000100:00100000:1.0:1789427825.635313:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583616 00000100:00100000:3.0:1789427825.635323:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584000 00000100:00100000:3.0:1789427825.635331:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584000 00000100:00100000:2.0:1789427825.635347:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427825.635366:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931583872 00000100:00100000:0.0:1789427825.635371:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931583872 00000100:00100000:3.0:1789427825.635377:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584128 00000100:00100000:3.0:1789427825.635381:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584128 00000100:00100000:0.0:1789427825.635405:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00080000:2.0:1789427825.635451:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427825.635452:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00080000:2.0:1789427825.635457:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427825.635458:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931583744:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427825.635475:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931584000:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427825.635476:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 298 00000100:00100000:1.0:1789427825.635499:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931583616:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427825.635517:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:2.0:1789427825.635527:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931583872:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427825.635541:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931583744:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427825.635542:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931584000:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.635555:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:3.0:1789427825.635561:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:0.0:1789427825.635587:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:2.0:1789427825.635588:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931583872:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 51us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427825.635589:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931583616:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.635603:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931584128:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427825.635614:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:1.0:1789427825.635637:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 298 00000100:00100000:0.0:1789427825.635661:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931584128:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.635668:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:3.0:1789427825.968641:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940036864:0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.968656:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940037248:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.968687:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940037376:0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.968735:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940037120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427825.968746:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427825.968763:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427825.968763:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427825.968819:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427825.968839:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940036992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427825.968854:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940037888:0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.968860:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940037632:0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.968861:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940037760:0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.968889:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427825.968937:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940037504:0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.968944:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427825.968955:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427825.968959:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037120 00000100:00100000:2.0:1789427825.968967:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037120 00000100:00100000:1.0:1789427825.968987:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940038272:0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.968993:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427825.969007:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940038144:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969032:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036992 00000100:00100000:3.0:1789427825.969033:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940038016:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969035:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036992 00000100:00100000:1.0:1789427825.969065:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427825.969079:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789427825.969079:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427825.969097:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940037120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427825.969122:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940038656:0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.969126:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940036864 00000100:00100000:3.0:1789427825.969134:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940036864 00002000:00000024:2.0:1789427825.969137:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427825.969140:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789427825.969154:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427825.969163:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940036992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427825.969187:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427825.969192:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789427825.969204:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940037120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427825.969209:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940036864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969217:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1789427825.969218:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539c00 x1876350940037120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427825.969236:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940037120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789427825.969259:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427825.969284:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940036864:12345-0@lo:400:kworker.0 Request processed in 76us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.969284:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037376 00000100:00100000:1.0:1789427825.969291:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940036992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.969291:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037376 00000100:00100000:2.0:1789427825.969296:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038144 00000100:00100000:2.0:1789427825.969303:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038144 00000100:00100000:3.0:1789427825.969319:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789427825.969320:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789427825.969327:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037632 00000100:00100000:0.0:1789427825.969334:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037632 00000100:00100000:2.0:1789427825.969362:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038656 00000100:00100000:2.0:1789427825.969368:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038656 00000100:00100000:0.0:1789427825.969385:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789427825.969400:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.969401:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789427825.969447:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789427825.969457:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789427825.969463:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940037632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.969465:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940038144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969472:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940038656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.969476:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940037376:12345-0@lo:400:kworker.0 Request processed in 76us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.969493:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789427825.969534:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427825.969576:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940038144:12345-0@lo:400:kworker.0 Request processed in 116us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427825.969578:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940038656:12345-0@lo:400:kworker.0 Request processed in 113us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.969588:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940038400:0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.969592:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940037632:12345-0@lo:400:kworker.0 Request processed in 166us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427825.969608:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789427825.969615:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789427825.969632:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427825.969646:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427825.969677:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427825.969693:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037248 00000100:00100000:0.0:1789427825.969695:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940037376:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969698:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037760 00000100:00100000:2.0:1789427825.969706:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037760 00000100:00100000:1.0:1789427825.969706:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037248 00000100:00100000:3.0:1789427825.969715:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940038528:0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.969729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037504 00000100:00100000:0.0:1789427825.969735:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037504 00000100:00100000:3.0:1789427825.969759:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427825.969764:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038272 00000100:00100000:2.0:1789427825.969768:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038272 00000100:00100000:0.0:1789427825.969778:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940037888 00000100:00100000:0.0:1789427825.969784:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940037888 00000100:00100000:1.0:1789427825.969789:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038400 00000100:00100000:1.0:1789427825.969796:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038400 00000100:00100000:2.0:1789427825.969801:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789427825.969806:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940036864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969815:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940037760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.969825:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00010000:00080000:3.0:1789427825.969832:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad929180 x1876350940036992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427825.969840:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940037504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.969851:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789427825.969859:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940036992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427825.969864:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940037248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.969881:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940037760:12345-0@lo:400:kworker.0 Request processed in 69us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.969897:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940037504:12345-0@lo:400:kworker.0 Request processed in 62us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427825.969904:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789427825.969912:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940037504:0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.969918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789427825.969930:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940037248:12345-0@lo:400:kworker.0 Request processed in 66us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427825.969940:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789427825.969949:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789427825.969953:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038016 00000100:00100000:2.0:1789427825.969955:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940038272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.969961:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038016 00000100:00100000:0.0:1789427825.969966:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427825.969974:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789427825.969982:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.969988:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940038400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.970014:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038528 00000100:00100000:3.0:1789427825.970021:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038528 00000100:00100000:2.0:1789427825.970024:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940038272:12345-0@lo:400:kworker.0 Request processed in 74us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427825.970036:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789427825.970056:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940037888:12345-0@lo:400:kworker.0 Request processed in 80us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.970069:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427825.970070:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940038400:12345-0@lo:400:kworker.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427825.970071:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789427825.970085:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789427825.970097:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.970097:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789427825.970104:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427825.970110:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940037632:0@lo:400:kworker.0 00010000:00080000:0.0:1789427825.970149:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cb8000 x1876350940038144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427825.970161:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940038144:0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.970169:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940038016:12345-0@lo:400:kworker.0 Request processed in 84us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427825.970181:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789427825.970190:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940037760:0@lo:400:kworker.0 00010000:00080000:0.0:1789427825.970193:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df6680 x1876350940038656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427825.970194:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940038528:12345-0@lo:400:kworker.0 Request processed in 89us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427825.970221:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940038656:0@lo:400:kworker.0 00000100:00100000:2.0:1789427825.970223:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789427825.970227:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940038016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427825.970237:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940038272:0@lo:400:kworker.0 00000100:00080000:2.0:1789427825.970257:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789427825.970264:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cba300 x1876350940037888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789427825.970266:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427825.970268:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940038016:0@lo:400:kworker.0 00000100:00080000:2.0:1789427825.970272:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427825.970285:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940037888:0@lo:400:kworker.0 00000100:00100000:1.0:1789427825.970286:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940037248:0@lo:400:kworker.0 00010000:00080000:3.0:1789427825.970304:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4e00 x1876350940038528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789427825.970307:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb800 x1876350940038400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427825.970333:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940038400:0@lo:400:kworker.0 00000100:00100000:3.0:1789427825.970335:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940038528:0@lo:400:kworker.0 00010000:00010000:0.0:1789427826.096612:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427826.992748:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940038784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427826.992822:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427826.992890:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038784 00000100:00100000:3.0:1789427826.992903:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038784 00000100:00100000:3.0:1789427826.992981:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789427826.992992:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940038784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427826.993032:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427826.993130:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940038784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427826.993139:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427826.993153:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940038912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427826.993197:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427826.993329:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940038912 00000100:00100000:3.0:1789427826.993334:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940038912 00000100:00100000:3.0:1789427826.993367:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789427826.993376:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940038912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789427826.993389:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427826.993445:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940038912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427826.993452:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789427826.993465:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fea00 x1876350940038912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427826.993491:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940038912:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789427826.993681:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361d880 x1876350940038784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427826.993703:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940038784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427827.120663:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427828.016636:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940039040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427828.016720:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427828.016757:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039040 00000100:00100000:0.0:1789427828.016766:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039040 00000100:00100000:0.0:1789427828.016820:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789427828.016829:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940039040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427828.016865:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427828.016911:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940039040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427828.016917:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789427828.016959:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940039040:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427828.144633:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427829.168855:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427829.997188:0:13147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff66748dd0 20000000:00000080:0.0:1789427829.997205:0:13147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff919583c19c00 uarg=0000000000000000 20000000:01000000:0.0:1789427829.997244:0:13147:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789427829.997249:0:13147:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789427829.997253:0:13147:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789427829.998095:0:13148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789427829.998250:0:13147:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789427830.003143:0:13147:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789427830.003174:0:13147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003193:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003201:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003209:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003229:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003239:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003246:0:13147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003252:0:13147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003309:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003325:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.003340:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039168:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427830.003479:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.003488:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.003496:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039296:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427830.005049:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.005073:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 23 pid: 6478 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.005086:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039424:0@lo:104: 00000100:00100000:0.0:1789427830.005131:0:13147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427830.005168:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.005177:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 23 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.005185:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039552:0@lo:104: 00000100:00100000:0.0:1789427830.005201:0:13147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427830.005217:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.005224:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 23 pid: 6475 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.005231:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039680:0@lo:104: 00000100:00100000:0.0:1789427830.005250:0:13147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427830.005470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039424 00000100:00100000:1.0:1789427830.005478:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039424 00000100:00100000:1.0:1789427830.005524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039552 00000100:00100000:1.0:1789427830.005527:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039552 00000100:00100000:1.0:1789427830.005536:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039680 00000100:00100000:1.0:1789427830.005538:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039680 00000100:00100000:1.0:1789427830.005548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789427830.005555:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:13147:x1876350940039424:12345-0@lo:104: 00010000:00010000:1.0:1789427830.005568:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005624:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427830.005630:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:13147:x1876350940039424:12345-0@lo:104: Request processed in 76us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.005637:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789427830.005653:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789427830.005658:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:13147:x1876350940039552:12345-0@lo:104: 00010000:00010000:1.0:1789427830.005672:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005700:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789427830.005704:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:13147:x1876350940039552:12345-0@lo:104: Request processed in 46us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.005710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789427830.005720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789427830.005725:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:13147:x1876350940039680:12345-0@lo:104: 00010000:00010000:1.0:1789427830.005731:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005760:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789427830.005764:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:13147:x1876350940039680:12345-0@lo:104: Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.005769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789427830.005785:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789427830.005790:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005798:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427830.005802:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005810:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427830.005817:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427830.005829:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427830.005860:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005866:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427830.005887:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005895:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5183e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183e8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005910:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427830.005913:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005918:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427830.005920:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005927:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427830.005934:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427830.005939:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427830.005965:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005970:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427830.005989:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.005996:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5183d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183da expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006004:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427830.006007:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006013:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427830.006015:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006022:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427830.006028:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427830.006033:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427830.006044:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006050:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427830.006055:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006062:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583429a00/0x84fc867ede5183c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183cc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006071:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.006077:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.006079:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.006085:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.006090:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427830.006107:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940039936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.006134:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427830.006169:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.006188:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427830.006202:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427830.006207:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.006221:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427830.006247:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039936 00000100:00100000:1.0:1789427830.006252:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039936 00010000:00010000:1.0:1789427830.006272:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 24 pid: 6478 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.006428:0:13147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.006441:0:13147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 24 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.006453:0:13147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039808:0@lo:104: 00000100:00100000:0.0:1789427830.006482:0:13147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427830.006498:0:13147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdaca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427830.006569:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039424:0@lo:104: 00000100:00100000:0.0:1789427830.006578:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039552:0@lo:104: 00000100:00100000:0.0:1789427830.006594:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039680:0@lo:104: 00000100:00100000:1.0:1789427830.006667:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040064 00000100:00100000:1.0:1789427830.006670:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040064 00010000:00010000:1.0:1789427830.006683:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 25 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.006698:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040192 00000100:00100000:1.0:1789427830.006701:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040192 00010000:00010000:1.0:1789427830.006708:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 26 pid: 6475 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.006719:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427830.006725:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+26:3614:x1876350940039936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427830.006735:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427830.006746:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 26 pid: 6478 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006755:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 26 pid: 6478 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006768:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ec000/0x84fc867ede5183e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5183e1 expref: 26 pid: 6478 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006780:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427830.006809:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3614:x1876350940039936:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.006815:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427830.006830:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789427830.006835:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940040064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427830.006842:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427830.006846:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 24 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006854:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 24 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006864:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429200/0x84fc867ede5183da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5183d3 expref: 24 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006873:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427830.006895:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3615:x1876350940040064:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.006901:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789427830.006912:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789427830.006922:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3615:x1876350940040192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427830.006929:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427830.006933:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 22 pid: 6475 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006941:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 22 pid: 6475 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006951:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429400/0x84fc867ede5183cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5183c5 expref: 22 pid: 6475 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.006958:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427830.006975:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3615:x1876350940040192:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.006981:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789427830.007012:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940039936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.007033:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.007040:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427830.007052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940039808 00000100:00100000:1.0:1789427830.007055:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940039808 00000100:00100000:1.0:1789427830.007069:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789427830.007074:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:13147:x1876350940039808:12345-0@lo:104: 00010000:00010000:1.0:1789427830.007082:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007114:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427830.007119:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:13147:x1876350940039808:12345-0@lo:104: Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.007129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789427830.007143:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427830.007148:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007155:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427830.007158:0:7424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007165:0:7424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427830.007172:0:7424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427830.007177:0:7424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427830.007195:0:7424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007201:0:7424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427830.007209:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007216:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91968883a800/0x84fc867ede5183b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5183be expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.007227:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.007229:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427830.007230:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427830.007240:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427830.007254:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940040320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427830.007374:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039808:0@lo:104: 00000100:00100000:1.0:1789427830.007757:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427830.007935:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040320 00000100:00100000:0.0:1789427830.007940:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040320 00010000:00010000:0.0:1789427830.007959:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.007986:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427830.007992:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3614:x1876350940040320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427830.008013:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427830.008018:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.008026:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.008037:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208800/0x84fc867ede5183be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5183b7 expref: 21 pid: 6477 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427830.008046:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427830.008084:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3614:x1876350940040320:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427830.008091:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789427830.008143:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940040320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427830.013323:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427830.013697:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584384 00000100:00100000:1.0:1789427830.013706:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584384 00010000:00010000:1.0:1789427830.013745:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 13 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.013780:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1789427830.013790:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931584384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427830.013805:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427830.013810:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 13 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.013820:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 13 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.013839:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427830.013898:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931584384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.013906:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789427830.014590:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039168:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427830.014620:0:13147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429000/0x84fc867ede5183ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a50 expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427830.014633:0:13147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13147:1876350940039296:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427830.014720:0:13147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.015159:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427830.015223:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584256 00000100:00100000:0.0:1789427830.015229:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584256 00010000:00010000:0.0:1789427830.015252:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.015357:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:1.0:1789427830.015368:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688832450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:2396:x1876350931584256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427830.015380:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427830.015386:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015396:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015483:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209600/0x84fc867ede518404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a8f expref: 12 pid: 6477 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015497:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015505:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015631:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015639:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015646:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015653:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015658:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427830.015663:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015671:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015692:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427830.015712:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427830.015848:0:13147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427830.015856:0:13147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427830.015863:0:13147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e600/0x84fc867ede518427 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427830.017274:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688832450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2396:x1876350931584256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1903us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.017286:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00010000:00010000:1.0:1789427830.192647:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427830.578489:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427830.578511:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940040448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427830.578600:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427830.578860:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040448 00000100:00100000:2.0:1789427830.578882:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040448 00000100:00100000:2.0:1789427830.578932:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789427830.578941:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940040448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427830.578974:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427830.579025:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940040448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427830.579032:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789427830.579198:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940040448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427830.756050:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427830.756099:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427830.756140:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427830.756173:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427830.756223:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427830.757109:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584512 00000100:00100000:1.0:1789427830.757121:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584512 00000100:00100000:1.0:1789427830.757180:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 300 00000100:00100000:1.0:1789427830.757189:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2396:x1876350931584512:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427830.757253:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2396:x1876350931584512:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 65us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.757259:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 300 00000100:00100000:1.0:1789427830.757291:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584640 00000100:00100000:1.0:1789427830.757295:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584640 00000100:00100000:1.0:1789427830.757325:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584896 00000100:00100000:1.0:1789427830.757327:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584896 00000100:00100000:1.0:1789427830.757339:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931584768 00000100:00100000:1.0:1789427830.757341:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931584768 00000100:00100000:1.0:1789427830.757352:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585024 00000100:00100000:1.0:1789427830.757354:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585024 00000100:00100000:1.0:1789427830.757367:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:1.0:1789427830.757372:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931584640:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427830.757398:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931584640:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.757404:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:1.0:1789427830.757448:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789427830.757462:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931584896:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427830.757487:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931584896:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.757492:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789427830.757505:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:1.0:1789427830.757511:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931584768:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427830.757532:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931584768:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.757538:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:1.0:1789427830.757549:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:1.0:1789427830.757555:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931585024:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427830.757608:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931585024:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 20us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427830.757615:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00080000:2.0:1789427830.758028:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427830.758033:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427831.088777:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940040960:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.088843:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.088895:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940041472:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.088915:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.088925:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940041984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.088935:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.088956:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789427831.088960:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940040832:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.088974:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.088998:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940041344:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.089011:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.089020:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940041856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.089029:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.089047:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041472 00000100:00100000:1.0:1789427831.089053:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041472 00000100:00100000:1.0:1789427831.089087:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041984 00000100:00100000:1.0:1789427831.089089:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041984 00000100:00100000:1.0:1789427831.089096:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041344 00000100:00100000:1.0:1789427831.089097:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041344 00000100:00100000:1.0:1789427831.089105:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041856 00000100:00100000:1.0:1789427831.089106:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041856 00000100:00100000:1.0:1789427831.089114:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789427831.089120:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940041472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089317:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040576:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089342:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089356:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940041088:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089368:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089377:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940041600:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089387:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089395:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427831.089406:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089432:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789427831.089438:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940040704:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089459:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089477:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940041216:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089497:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089512:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940041728:0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089530:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.089549:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427831.089559:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940041984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089611:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940041984:12345-0@lo:400:kworker.0 Request processed in 51us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089618:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427831.089638:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789427831.089645:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940041344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089672:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940041344:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089677:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789427831.089690:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789427831.089696:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940041856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089721:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940041856:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089727:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789427831.089745:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040960 00000100:00100000:2.0:1789427831.089748:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040960 00000100:00100000:2.0:1789427831.089766:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041088 00000100:00100000:2.0:1789427831.089769:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041088 00000100:00100000:2.0:1789427831.089781:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041600 00000100:00100000:2.0:1789427831.089783:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041600 00000100:00100000:2.0:1789427831.089793:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040704 00000100:00100000:2.0:1789427831.089795:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040704 00000100:00100000:2.0:1789427831.089805:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041216 00000100:00100000:2.0:1789427831.089807:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041216 00000100:00100000:2.0:1789427831.089817:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940041728 00000100:00100000:2.0:1789427831.089819:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940041728 00000100:00100000:2.0:1789427831.089831:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789427831.089837:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940040960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089876:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940040960:12345-0@lo:400:kworker.0 Request processed in 38us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089882:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789427831.089894:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789427831.089899:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940041088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089929:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940041088:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089934:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789427831.089945:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789427831.089952:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940041600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.089976:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940041600:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.089980:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789427831.089991:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427831.089995:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940040704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.090018:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940040704:12345-0@lo:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.090023:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427831.090033:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789427831.090038:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940041216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.090064:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940041216:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.090069:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789427831.090079:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789427831.090086:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940041728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427831.090120:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940041728:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.090127:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789427831.090449:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940041472:12345-0@lo:400:kworker.0 Request processed in 1327us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427831.090456:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789427831.090477:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040832 00000100:00100000:1.0:1789427831.090481:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040832 00000100:00100000:1.0:1789427831.090507:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789427831.090513:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940040832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.090544:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940040832:12345-0@lo:400:kworker.0 Request processed in 31us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427831.090550:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789427831.090569:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427831.090583:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789427831.090586:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427831.090588:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427831.090617:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940040832:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.090645:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf987b80 x1876350940041344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.090656:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940041344:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.090669:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940041856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.090678:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940041856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.090691:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940040960:0@lo:400:kworker.0 00000100:00100000:3.0:1789427831.090694:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940040576 00000100:00100000:3.0:1789427831.090700:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940040576 00010000:00080000:1.0:1789427831.090701:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4e00 x1876350940041472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.090712:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940041472:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.090725:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cba300 x1876350940041984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.090733:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940041984:0@lo:400:kworker.0 00000100:00100000:3.0:1789427831.090738:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789427831.090748:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3615:x1876350940040576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.090811:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042112 00000100:00100000:1.0:1789427831.090815:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042112 00000100:00100000:1.0:1789427831.090840:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789427831.090847:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940042112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427831.090869:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427831.090899:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940042112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427831.090905:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789427831.091033:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3615:x1876350940040576:12345-0@lo:400:kworker.0 Request processed in 287us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.091041:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789427831.091070:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940042240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427831.091097:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427831.091129:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042240 00000100:00100000:3.0:1789427831.091134:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042240 00000100:00100000:3.0:1789427831.091155:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427831.091161:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940042240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427831.091171:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427831.091199:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940042240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.091204:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789427831.091237:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf6680 x1876350940042240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427831.091250:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940042240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427831.091439:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940040704:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.091462:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf985c00 x1876350940041216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.091472:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940041216:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.091481:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb800 x1876350940041728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.091489:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940041728:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.091497:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940040576:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.091506:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940041088:0@lo:400:kworker.0 00000100:00100000:1.0:1789427831.091515:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940041600:0@lo:400:kworker.0 00010000:00080000:1.0:1789427831.091527:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf6a00 x1876350940042112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.091540:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940042112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427831.219130:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789427831.856632:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427831.856641:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8a000 from 7 10000000:01000000:2.0:1789427831.856646:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427831.856695:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.856707:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.856719:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427831.856747:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.856816:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427831.856879:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042368 00000100:00100000:2.0:1789427831.856880:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684c56300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427831.856889:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042368 00000100:00100000:3.0:1789427831.856942:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789427831.856951:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940042368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427831.856965:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427831.856977:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51842e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.857001:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51842e expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.857012:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51842e expref: 21 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.857035:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883aa00, rc 0) 00000100:00100000:3.0:1789427831.857190:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.857198:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789427831.857757:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427831.857772:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.857783:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427831.857840:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.857868:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.857899:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684c56300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427831.857976:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042496 00000100:00100000:3.0:1789427831.857981:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042496 00000100:00100000:3.0:1789427831.858028:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789427831.858035:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.858152:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.858176:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789427831.858461:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.858488:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.858527:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.858557:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.858618:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042624 00000100:00100000:2.0:1789427831.858623:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042624 00000100:00100000:2.0:1789427831.858657:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789427831.858664:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.858752:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.858760:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789427831.858872:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789427831.860777:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789427831.861563:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789427831.861601:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427831.861611:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.861622:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427831.861633:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789427831.861636:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bc9e1800 from 7 10000000:01000000:0.0:1789427831.861639:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427831.861679:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.861688:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.861698:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427831.861716:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.861762:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.861810:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.861913:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042752 00000100:00100000:2.0:1789427831.861919:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042752 00000100:00100000:2.0:1789427831.861998:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789427831.862007:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940042752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427831.862017:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427831.862028:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51843c expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.862049:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51843c expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.862060:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51843c expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.862069:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427831.862111:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940042752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.862118:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789427831.862322:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427831.862335:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.862346:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427831.862395:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.862463:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427831.862491:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427831.862496:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940042880 00000100:00100000:0.0:1789427831.862501:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940042880 00000100:00100000:0.0:1789427831.862534:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789427831.862541:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940042880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.862659:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940042880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427831.862667:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789427831.862695:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940042880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.862725:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.862770:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427831.862795:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.862818:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043008 00000100:00100000:2.0:1789427831.862824:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043008 00000100:00100000:2.0:1789427831.862854:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789427831.862861:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940043008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.862943:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940043008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.862953:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.862953:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000040:00080000:3.0:1789427831.864047:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789427831.864119:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789427831.864142:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427831.864159:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.864171:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427831.864180:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789427831.864183:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196adadd000 from 7 10000000:01000000:0.0:1789427831.864185:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427831.864209:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.864218:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.864226:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427831.864240:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.864280:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.864318:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.864435:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043136 00000100:00100000:2.0:1789427831.864441:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043136 00000100:00100000:2.0:1789427831.864470:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789427831.864478:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940043136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427831.864487:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427831.864496:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51844a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.864514:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.864523:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.864531:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429000, rc 0) 00000100:00100000:2.0:1789427831.864556:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.864563:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789427831.864704:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427831.864715:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.864724:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427831.864778:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.864805:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.864829:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.864919:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043264 00000100:00100000:2.0:1789427831.864924:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043264 00000100:00100000:2.0:1789427831.864949:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789427831.864956:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.865085:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.865100:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789427831.865210:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.865235:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.865267:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.865340:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.865375:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043392 00000100:00100000:2.0:1789427831.865380:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043392 00000100:00100000:2.0:1789427831.865408:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789427831.865438:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.865507:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.865515:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789427831.865542:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789427831.866606:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789427831.866703:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789427831.866723:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427831.866730:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.866741:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427831.866749:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789427831.866751:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919684ed8800 from 7 10000000:01000000:0.0:1789427831.866809:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427831.866826:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.866834:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.866842:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427831.866856:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.866886:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.866909:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427831.867043:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043520 00000100:00100000:2.0:1789427831.867049:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043520 00000100:00100000:2.0:1789427831.867079:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789427831.867292:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940043520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427831.867302:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427831.867311:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede518458 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.867329:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede518458 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.867339:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518458 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427831.867346:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427831.867387:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940043520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.867394:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789427831.867484:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427831.867496:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.867505:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427831.867555:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.867596:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427831.867617:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427831.867672:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043648 00000100:00100000:3.0:1789427831.867677:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043648 00000100:00100000:3.0:1789427831.867703:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789427831.867710:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940043648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.867799:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940043648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.867814:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789427831.867953:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.867982:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.868014:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427831.868033:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427831.868074:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043776 00000100:00100000:3.0:1789427831.868078:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043776 00000100:00100000:3.0:1789427831.868108:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789427831.868114:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940043776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.868288:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940043776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.868295:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789427831.868362:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940043776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789427831.869444:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789427831.869605:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789427831.869623:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427831.869629:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.869640:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427831.908412:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427831.908612:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585152 00000100:00100000:0.0:1789427831.908623:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585152 00000100:00100000:0.0:1789427831.908735:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 314 00000100:00100000:0.0:1789427831.908747:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:6156:x1876350931585152:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427831.908764:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427831.909862:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ac0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.909895:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.909907:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427831.909916:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ee00, rc 0) 00000100:00100000:0.0:1789427831.909997:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585152:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 1251us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427831.910012:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 314 00000100:00100000:1.0:1789427831.913757:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427831.914324:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585280 00000100:00100000:3.0:1789427831.914334:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585280 00000100:00100000:3.0:1789427831.914431:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 315 00000100:00100000:3.0:1789427831.914440:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585280:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427831.914586:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585280:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 146us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.914594:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 315 00000100:00100000:3.0:1789427831.916141:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427831.916452:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585408 00000100:00100000:0.0:1789427831.916460:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585408 00000100:00100000:0.0:1789427831.916491:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 316 00000100:00100000:0.0:1789427831.916496:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585408:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.916599:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585408:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427831.916607:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 316 00000100:00100000:0.0:1789427831.920955:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427831.921668:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585536 00000100:00100000:3.0:1789427831.921678:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585536 00000100:00100000:3.0:1789427831.921731:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 317 00000100:00100000:3.0:1789427831.921741:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931585536:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427831.921757:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427831.921866:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ac7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.921895:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.921915:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427831.921923:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883bc00, rc 0) 00000100:00100000:3.0:1789427831.921979:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931585536:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 237us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427831.921986:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 317 00000100:00100000:3.0:1789427831.923437:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427831.923461:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585664 00000100:00100000:0.0:1789427831.923468:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585664 00000100:00100000:2.0:1789427831.923533:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 318 00000100:00100000:2.0:1789427831.923543:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931585664:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427831.923677:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931585664:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 135us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427831.923685:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 318 00000100:00100000:3.0:1789427831.925751:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427831.925805:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585792 00000100:00100000:0.0:1789427831.925813:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585792 00000100:00100000:0.0:1789427831.925859:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 319 00000100:00100000:0.0:1789427831.925870:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931585792:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427831.925965:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931585792:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427831.925973:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 319 00000100:00100000:0.0:1789427832.112594:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940043904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427832.112672:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427832.115480:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940044032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427832.115499:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940043904 00000100:00100000:1.0:1789427832.115510:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940043904 00000100:00100000:2.0:1789427832.115541:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427832.117094:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044032 00000100:00100000:1.0:1789427832.117102:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044032 00000100:00100000:1.0:1789427832.117130:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789427832.117140:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940043904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427832.117172:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427832.117230:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940043904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427832.117246:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789427832.117264:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789427832.117271:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940044032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427832.117280:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427832.117313:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940044032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427832.117319:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789427832.117356:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf6a00 x1876350940043904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427832.117375:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940043904:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789427832.117700:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9fea00 x1876350940044032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427832.117711:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940044032:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427832.241275:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427832.758814:0:13345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789427833.136793:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427833.136815:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940044160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427833.136891:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427833.137224:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044160 00000100:00100000:0.0:1789427833.137233:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044160 00000100:00100000:0.0:1789427833.137292:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427833.137302:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940044160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427833.137333:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427833.137403:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940044160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427833.137545:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789427833.137736:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940044160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427833.264860:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427834.289513:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427835.313237:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427835.711374:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427835.711397:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940044288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427835.711499:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427835.711781:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044288 00000100:00100000:2.0:1789427835.711790:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044288 00000100:00100000:2.0:1789427835.711885:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789427835.711899:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940044288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427835.711933:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427835.711988:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940044288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427835.712007:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789427835.712069:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940044288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427835.877010:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427835.877057:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427835.877094:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427835.877117:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427835.877152:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427835.877184:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586048 00000100:00100000:0.0:1789427835.877194:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586048 00000100:00100000:0.0:1789427835.877247:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586176 00000100:00100000:0.0:1789427835.877250:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586176 00000100:00100000:0.0:1789427835.877263:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586304 00000100:00100000:0.0:1789427835.877266:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586304 00000100:00100000:0.0:1789427835.877282:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586432 00000100:00100000:0.0:1789427835.877285:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586432 00000100:00100000:0.0:1789427835.877303:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:0.0:1789427835.877314:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931586048:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427835.877388:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931586048:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427835.877395:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:0.0:1789427835.877438:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:0.0:1789427835.877445:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931586176:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427835.877473:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931586176:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427835.877478:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:0.0:1789427835.877491:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:0.0:1789427835.877512:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931586304:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427835.877547:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931586304:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427835.877553:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:0.0:1789427835.877567:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:0.0:1789427835.877573:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931586432:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427835.877595:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931586432:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427835.877601:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:2.0:1789427835.877855:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931585920 00000100:00100000:2.0:1789427835.877861:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931585920 00000100:00100000:2.0:1789427835.877898:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 320 00000100:00100000:2.0:1789427835.877904:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931585920:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427835.877939:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931585920:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427835.877945:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 320 00000100:00080000:1.0:1789427835.878195:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427835.878200:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427836.211914:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940044544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427836.211992:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427836.212054:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427836.212063:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940044416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427836.212088:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427836.212123:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044544 00000100:00100000:3.0:1789427836.212131:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044544 00000100:00100000:3.0:1789427836.212175:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044416 00000100:00100000:3.0:1789427836.212178:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044416 00000100:00100000:3.0:1789427836.212194:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427836.212203:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940044544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427836.212239:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427836.212285:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940044544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427836.212293:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427836.212312:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789427836.212318:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940044416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427836.212328:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427836.212351:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940044416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427836.212356:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789427836.212375:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789427836.212400:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf7b80 x1876350940044416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427836.212440:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940044416:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789427836.212453:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf5500 x1876350940044544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427836.212466:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940044544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427836.215958:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940044928:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.216064:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940045440:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216091:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.216115:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427836.216121:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940045056:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216146:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.216174:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940045568:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216195:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.216223:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045440 00000100:00100000:2.0:1789427836.216230:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045440 00000100:00100000:2.0:1789427836.216275:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045568 00000100:00100000:2.0:1789427836.216279:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045568 00000100:00100000:2.0:1789427836.216301:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789427836.216310:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216357:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940045440:12345-0@lo:400:kworker.0 Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.216374:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789427836.216390:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789427836.216396:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940045568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216449:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940045568:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.216456:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789427836.216477:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045056 00000100:00100000:2.0:1789427836.216481:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045056 00000100:00100000:2.0:1789427836.216507:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427836.216513:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940045056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.216557:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940045056:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.216564:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427836.216682:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940045056:0@lo:400:kworker.0 00010000:00080000:2.0:1789427836.216694:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e43800 x1876350940045568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427836.216705:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940045568:0@lo:400:kworker.0 00010000:00080000:2.0:1789427836.216715:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e43100 x1876350940045440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427836.216723:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940045440:0@lo:400:kworker.0 00000100:00100000:0.0:1789427836.216828:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044928 00000100:00100000:0.0:1789427836.216833:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044928 00000100:00100000:0.0:1789427836.216877:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427836.216885:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940044928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427836.216916:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940044928:12345-0@lo:400:kworker.0 Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427836.216922:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789427836.217675:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940044928:0@lo:400:kworker.0 00000100:00080000:2.0:1789427836.217696:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427836.217707:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940044672:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.217812:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.217842:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940045184:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.217865:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.217884:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940045696:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.217903:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.217921:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789427836.217927:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940044800:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.217946:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.217963:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940045312:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.217993:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.218011:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940045824:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218032:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.218056:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045184 00000100:00100000:2.0:1789427836.218060:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045184 00000100:00100000:2.0:1789427836.218086:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045696 00000100:00100000:2.0:1789427836.218089:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045696 00000100:00100000:2.0:1789427836.218101:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044800 00000100:00100000:2.0:1789427836.218103:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044800 00000100:00100000:2.0:1789427836.218112:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045312 00000100:00100000:2.0:1789427836.218114:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045312 00000100:00100000:2.0:1789427836.218122:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045824 00000100:00100000:2.0:1789427836.218124:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045824 00000100:00100000:2.0:1789427836.218135:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789427836.218141:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940045184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218173:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940045184:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.218179:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789427836.218195:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427836.218200:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940045696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218222:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940045696:12345-0@lo:400:kworker.0 Request processed in 22us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.218227:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427836.218237:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789427836.218242:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940044800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218262:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940044800:12345-0@lo:400:kworker.0 Request processed in 20us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.218267:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789427836.218276:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789427836.218281:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940045312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218298:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940045312:12345-0@lo:400:kworker.0 Request processed in 17us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.218302:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789427836.218310:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789427836.218315:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940045824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218331:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940045824:12345-0@lo:400:kworker.0 Request processed in 16us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.218336:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789427836.218353:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427836.218356:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427836.218369:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940044800:0@lo:400:kworker.0 00010000:00080000:2.0:1789427836.218379:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940045312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427836.218399:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940045312:0@lo:400:kworker.0 00010000:00080000:2.0:1789427836.218407:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e41880 x1876350940045824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427836.218430:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940045824:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218438:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940045184:0@lo:400:kworker.0 00000100:00100000:2.0:1789427836.218445:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940045696:0@lo:400:kworker.0 00000100:00100000:0.0:1789427836.218508:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940044672 00000100:00100000:0.0:1789427836.218512:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940044672 00000100:00100000:0.0:1789427836.218549:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789427836.218556:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427836.218654:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940044672:12345-0@lo:400:kworker.0 Request processed in 98us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427836.218660:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789427836.218690:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940044672:0@lo:400:kworker.0 00010000:00010000:1.0:1789427836.340395:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427837.232744:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427837.232854:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427837.232883:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940046080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427837.232983:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427837.233064:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046080 00000100:00100000:3.0:1789427837.233074:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046080 00000100:00100000:3.0:1789427837.233147:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789427837.233158:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940046080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427837.233199:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427837.233274:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940046080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427837.233281:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789427837.233609:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf4380 x1876350940046080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427837.233633:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940046080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427837.240400:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940045952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427837.240712:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427837.245982:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940045952 00000100:00100000:2.0:1789427837.246004:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940045952 00000100:00100000:2.0:1789427837.246132:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789427837.246145:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940045952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427837.246182:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427837.246301:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940045952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427837.246310:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789427837.246392:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583eda300 x1876350940045952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427837.246445:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940045952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427837.361868:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427837.970110:0:13494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:17:16 (1789427836) === 00000100:00100000:0.0:1789427838.256911:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940046208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427838.256979:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427838.257261:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046208 00000100:00100000:1.0:1789427838.257270:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046208 00000100:00100000:1.0:1789427838.257322:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789427838.257331:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940046208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427838.257363:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789427838.259695:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940046208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2360us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427838.259707:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789427838.260273:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940046208:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427838.387737:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427839.409544:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427840.432521:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427840.816818:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427840.816846:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940046336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427840.816922:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427840.816989:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046336 00000100:00100000:1.0:1789427840.817003:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046336 00000100:00100000:1.0:1789427840.817053:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789427840.817063:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940046336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427840.817094:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427840.817145:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940046336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427840.817152:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789427840.817198:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940046336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427840.995096:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427840.995142:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427840.995173:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427840.995205:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427840.995231:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427840.995256:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586688 00000100:00100000:2.0:1789427840.995276:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586688 00000100:00100000:2.0:1789427840.995326:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586816 00000100:00100000:2.0:1789427840.995340:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586816 00000100:00100000:2.0:1789427840.995354:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586944 00000100:00100000:2.0:1789427840.995357:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586944 00000100:00100000:2.0:1789427840.995368:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587072 00000100:00100000:2.0:1789427840.995371:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587072 00000100:00100000:2.0:1789427840.995386:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:2.0:1789427840.995395:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931586688:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427840.995507:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931586688:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427840.995514:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:2.0:1789427840.995531:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:2.0:1789427840.995538:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931586816:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427840.995562:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931586816:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427840.995568:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:2.0:1789427840.995579:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:2.0:1789427840.995585:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931586944:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427840.995619:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931586944:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427840.995625:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:2.0:1789427840.995637:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00100000:2.0:1789427840.995643:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931587072:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427840.995666:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931587072:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427840.995684:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00080000:2.0:1789427840.995711:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427840.995714:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427840.995789:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931586560 00000100:00100000:0.0:1789427840.995793:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931586560 00000100:00100000:0.0:1789427840.995830:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 322 00000100:00100000:0.0:1789427840.995837:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931586560:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427840.995863:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931586560:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427840.995869:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 322 00000100:00100000:0.0:1789427841.328665:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940046720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427841.328668:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940046976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.328694:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940047104:0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.328761:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427841.328762:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940046848:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.328762:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.328764:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427841.328809:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427841.328834:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940046464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427841.328835:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940047360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.328838:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940047488:0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.328840:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940047616:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.328887:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427841.328894:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.328901:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.328905:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046976 00000100:00100000:1.0:1789427841.328913:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046976 00000100:00100000:3.0:1789427841.328930:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940047872:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.328938:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940046592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.328940:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940048128:0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.328966:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.328977:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789427841.328978:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.328995:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940046976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.328996:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789427841.329009:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940047232:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.329022:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.329026:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047616 00000100:00100000:2.0:1789427841.329031:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047616 00000100:00100000:3.0:1789427841.329047:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.329072:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940046976:12345-0@lo:400:kworker.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.329080:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940047744:0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.329080:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789427841.329086:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046720 00000100:00100000:0.0:1789427841.329092:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046720 00000100:00100000:2.0:1789427841.329096:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048128 00000100:00100000:2.0:1789427841.329102:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048128 00000100:00100000:3.0:1789427841.329115:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.329127:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046464 00000100:00100000:1.0:1789427841.329133:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046464 00000100:00100000:2.0:1789427841.329149:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789427841.329151:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047104 00000100:00100000:3.0:1789427841.329157:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047104 00000100:00100000:0.0:1789427841.329157:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789427841.329162:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940047616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.329174:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789427841.329184:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940046720:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427841.329196:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940046464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427841.329199:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046848 00000100:00100000:3.0:1789427841.329204:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046848 00000100:00100000:2.0:1789427841.329207:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940047616:12345-0@lo:400:kworker.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.329219:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789427841.329225:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047360 00000100:00100000:3.0:1789427841.329230:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047360 00002000:00000024:1.0:1789427841.329232:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789427841.329232:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427841.329240:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789427841.329249:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329252:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047872 00000100:00100000:3.0:1789427841.329255:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047872 00000100:00100000:3.0:1789427841.329280:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047232 00000100:00100000:3.0:1789427841.329284:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047232 00000100:00100000:1.0:1789427841.329288:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940046464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.329297:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940046720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.329299:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789427841.329300:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940048128:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.329318:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789427841.329319:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789427841.329321:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047744 00000100:00100000:3.0:1789427841.329325:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047744 00000100:00100000:1.0:1789427841.329340:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940046592 00000100:00100000:1.0:1789427841.329346:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940046592 00000100:00100000:3.0:1789427841.329350:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789427841.329358:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940047104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.329375:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00010000:00080000:0.0:1789427841.329375:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583edbb80 x1876350940046720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427841.329391:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940046848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.329391:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789427841.329396:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940047104:12345-0@lo:400:kworker.0 Request processed in 37us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.329400:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940046720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427841.329405:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940046592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329406:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:0.0:1789427841.329456:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf4700 x1876350940046464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427841.329463:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427841.329493:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940046464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427841.329500:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940047360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.329501:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940046848:12345-0@lo:400:kworker.0 Request processed in 114us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.329507:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940046592:12345-0@lo:400:kworker.0 Request processed in 103us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.329517:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940046592:0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.329520:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789427841.329535:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789427841.329561:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789427841.329564:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940047360:12345-0@lo:400:kworker.0 Request processed in 87us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.329571:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940047872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329579:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427841.329593:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00010000:00080000:1.0:1789427841.329599:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa33b80 x1876350940047616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427841.329603:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789427841.329605:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940047232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.329611:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940047872:12345-0@lo:400:kworker.0 Request processed in 41us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.329618:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940047744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427841.329629:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789427841.329630:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940047616:0@lo:400:kworker.0 00010000:00080000:1.0:1789427841.329649:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa30000 x1876350940048128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427841.329655:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940047232:12345-0@lo:400:kworker.0 Request processed in 54us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.329666:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940048128:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.329666:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789427841.329674:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940047744:12345-0@lo:400:kworker.0 Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.329682:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789427841.329692:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940047104:0@lo:400:kworker.0 00000100:00080000:0.0:1789427841.329695:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427841.329697:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940047232:0@lo:400:kworker.0 00000100:00080000:0.0:1789427841.329703:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427841.329708:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427841.329711:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427841.329718:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940047744:0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329726:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.329734:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940046848:0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329753:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940048000:0@lo:400:kworker.0 00010000:00080000:2.0:1789427841.329756:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa30a80 x1876350940047360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427841.329756:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940047488 00000100:00100000:0.0:1789427841.329761:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940047488 00000100:00100000:2.0:1789427841.329770:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940047360:0@lo:400:kworker.0 00000100:00100000:3.0:1789427841.329786:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789427841.329789:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa30380 x1876350940047872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427841.329799:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940047872:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.329800:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048000 00000100:00080000:1.0:1789427841.329802:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427841.329807:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048000 00000100:00100000:3.0:1789427841.329820:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940046976:0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.329844:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427841.329857:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789427841.329858:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940047488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427841.329871:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940048000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427841.329899:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940047488:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.329905:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789427841.329917:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa32680 x1876350940047488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427841.329922:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940048000:12345-0@lo:400:kworker.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.329930:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940047488:0@lo:400:kworker.0 00010000:00080000:3.0:1789427841.329941:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa30700 x1876350940048000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427841.329945:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789427841.329956:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940048000:0@lo:400:kworker.0 00010000:00010000:1.0:1789427841.456677:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427842.352615:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940048256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427842.352684:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427842.352739:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048256 00000100:00100000:1.0:1789427842.352749:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048256 00000100:00100000:0.0:1789427842.352753:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940048384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427842.352784:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427842.352808:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048384 00000100:00100000:1.0:1789427842.352813:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048384 00000100:00100000:1.0:1789427842.352839:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427842.352849:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940048256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427842.352856:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789427842.352870:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940048384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427842.352879:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789427842.352886:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427842.352946:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940048384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427842.352955:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789427842.352961:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940048256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427842.352968:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789427842.352975:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf5f80 x1876350940048256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427842.352991:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940048256:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789427842.352999:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ed8000 x1876350940048384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427842.353006:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940048384:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427842.480610:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427843.376639:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940048512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427843.376712:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427843.376755:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048512 00000100:00100000:1.0:1789427843.376763:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048512 00000100:00100000:1.0:1789427843.376809:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789427843.376817:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940048512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427843.376841:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789427843.376883:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940048512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427843.376890:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427843.376940:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940048512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427843.504656:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427844.528577:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427844.907804:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427844.907863:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427844.907976:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587200 00000100:00100000:0.0:1789427844.907988:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587200 00000100:00100000:0.0:1789427844.908073:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789427844.908098:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931587200:12345-192.168.202.24@tcp:41:mkdir.0 00000004:00000024:0.0:1789427844.908137:0:10064:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427844.908226:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931587200:12345-192.168.202.24@tcp:41:mkdir.0 Request processed in 130us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427844.908233:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00080000:2.0:1789427844.908399:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427844.909504:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587328 00000100:00100000:1.0:1789427844.909519:0:7440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587328 00000100:00100000:1.0:1789427844.909582:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1789427844.909591:0:7440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:2f916dfa-5c35-44f7-8247-070d65680205+6:10472:x1876350931587328:12345-192.168.202.24@tcp:700:mkdir.0 00000100:00100000:1.0:1789427844.909693:0:7440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:2f916dfa-5c35-44f7-8247-070d65680205+6:10472:x1876350931587328:12345-192.168.202.24@tcp:700:mkdir.0 Request processed in 103us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427844.909702:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1789427844.914973:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427844.915095:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587584 00000100:00100000:0.0:1789427844.915105:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587584 00000100:00100000:0.0:1789427844.915274:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789427844.915286:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:10472:x1876350931587584:12345-192.168.202.24@tcp:36:mkdir.0 00010000:00010000:0.0:1789427844.915344:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427844.915373:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede518316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a3b expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915395:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427844.915406:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427844.915579:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915593:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915603:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915641:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915648:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.915673:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916283:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916293:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916301:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427844.916314:0:6483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000603b72e7 reply state 00000000bf574c10 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916324:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916330:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:0.0:1789427844.916332:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427844.916335:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789427844.916340:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789427844.916346:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916352:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916358:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916364:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427844.916375:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916382:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916391:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9195836a8700) 00010000:00010000:0.0:1789427844.916394:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427844.916397:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916403:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518474 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427844.916465:0:6483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000603b72e7 reply state 00000000bf574c10 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916474:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427844.916480:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9195836a8d00) 00010000:00010000:0.0:1789427844.916483:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427844.916485:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789427844.916565:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:10472:x1876350931587584:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 1280us (1604us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789427844.916573:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789427844.944514:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427844.944670:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587712 00000100:00100000:2.0:1789427844.944680:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587712 00000100:00100000:2.0:1789427844.944738:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1789427844.944749:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:10473:x1876350931587712:12345-192.168.202.24@tcp:101:chmod.0 00010000:00010000:2.0:1789427844.944785:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427844.944809:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ace expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.944871:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.944884:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.944896:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427844.944940:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789427844.944944:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427844.944976:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.945001:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ace expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.945018:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ace expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427844.945026:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789427844.945029:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427844.945033:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429200, rc 0) 00000100:00100000:2.0:1789427844.945096:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:10473:x1876350931587712:12345-192.168.202.24@tcp:101:chmod.0 Request processed in 349us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427844.945103:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:1.0:1789427844.948835:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427844.948930:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931587968 00000100:00100000:3.0:1789427844.948939:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931587968 00000100:00100000:3.0:1789427844.948999:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789427844.949010:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:10473:x1876350931587968:12345-192.168.202.24@tcp:36:chmod.0 00010000:00010000:3.0:1789427844.949060:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427844.949088:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede518490 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ace expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427844.949107:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:3.0:1789427844.949118:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427844.949142:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427844.949155:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427844.949165:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427844.949376:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b102ebcb reply state 000000007399a965 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427844.949395:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427844.949401:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:3.0:1789427844.949405:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789427844.949407:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789427844.949460:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789427844.949558:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+9:10473:x1876350931587968:12345-192.168.202.24@tcp:36:chmod.0 Request processed in 549us (732us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789427844.949566:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789427845.014895:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427845.015100:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588096 00000100:00100000:0.0:1789427845.015111:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588096 00000100:00100000:0.0:1789427845.015323:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:0.0:1789427845.015335:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:10474:x1876350931588096:12345-192.168.202.24@tcp:101:chown.0 00010000:00010000:0.0:1789427845.015386:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427845.015407:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51849e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ad5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015625:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015639:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015649:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427845.015687:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789427845.015691:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427845.015729:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015756:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51849e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ad5 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015774:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ad5 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427845.015783:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:0.0:1789427845.015785:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427845.015789:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e400, rc 0) 00000100:00100000:0.0:1789427845.015908:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+10:10474:x1876350931588096:12345-192.168.202.24@tcp:101:chown.0 Request processed in 575us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427845.015915:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:0.0:1789427845.019045:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.019111:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588224 00000100:00100000:2.0:1789427845.019122:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588224 00000100:00100000:2.0:1789427845.019187:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:2.0:1789427845.019196:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+10:10474:x1876350931588224:12345-192.168.202.24@tcp:101:chown.0 00010000:00010000:2.0:1789427845.019224:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427845.019244:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300adc expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019301:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019315:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019325:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019335:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019342:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019348:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019481:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019490:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019525:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427845.019566:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789427845.019570:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427845.019590:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019602:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019608:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019615:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019620:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.019625:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019633:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019645:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:2.0:1789427845.019648:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.019653:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019660:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019682:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019688:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019694:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019700:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.019703:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019709:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019716:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9195836a8d00) 00010000:00010000:2.0:1789427845.019719:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.019722:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019727:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019752:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300adc expref: 12 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019765:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300adc expref: 11 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.019782:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:2.0:1789427845.019785:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427845.019787:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429200, rc 0) 00000100:00100000:2.0:1789427845.019847:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+11:10474:x1876350931588224:12345-192.168.202.24@tcp:101:chown.0 Request processed in 651us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427845.019853:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1789427845.023971:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427845.024052:0:8903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588352 00000100:00100000:0.0:1789427845.024063:0:8903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588352 00000100:00100000:0.0:1789427845.024119:0:8903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1789427845.024129:0:8903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:2f916dfa-5c35-44f7-8247-070d65680205+11:10474:x1876350931588352:12345-192.168.202.24@tcp:900:chown.0 00000100:00100000:0.0:1789427845.024222:0:8903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:2f916dfa-5c35-44f7-8247-070d65680205+11:10474:x1876350931588352:12345-192.168.202.24@tcp:900:chown.0 Request processed in 94us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427845.024230:0:8903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1789427845.027222:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427845.027455:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588608 00000100:00100000:1.0:1789427845.027464:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588608 00000100:00100000:1.0:1789427845.027525:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:1.0:1789427845.027536:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+11:10474:x1876350931588608:12345-192.168.202.24@tcp:36:chown.0 00010000:00010000:1.0:1789427845.027586:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427845.027613:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede5184c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300adc expref: 11 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.027632:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:1.0:1789427845.027637:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427845.027659:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.027671:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.027681:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427845.030628:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1789427845.030735:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030748:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030755:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030761:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.030765:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030772:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030810:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9195836a8d00) 00010000:00010000:2.0:1789427845.030813:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.030817:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030822:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51847b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030852:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030858:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030863:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030868:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.030870:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030876:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030882:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:2.0:1789427845.030885:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.030887:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030892:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518482 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030904:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030909:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030914:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030923:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.030926:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030932:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030940:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:2.0:1789427845.030942:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789427845.030945:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.030950:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518497 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427845.031027:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003e80e2b8 reply state 00000000f04e51fa transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.031046:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.031060:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:1.0:1789427845.031062:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789427845.031065:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789427845.031076:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1789427845.031169:0:8108:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789427845.031187:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:10474:x1876350931588608:12345-192.168.202.24@tcp:36:chown.0 Request processed in 3649us (3971us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789427845.031196:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00010000:00010000:2.0:1789427845.031269:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031277:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031282:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031287:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.031290:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031296:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031313:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9195836a8b00) 00010000:00010000:2.0:1789427845.031315:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789427845.031318:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.031324:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede5184c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427845.053107:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427845.053287:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588736 00000100:00100000:0.0:1789427845.053296:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588736 00000100:00100000:0.0:1789427845.053349:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:0.0:1789427845.053359:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:10475:x1876350931588736:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:0.0:1789427845.053390:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427845.053409:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5184cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ae3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427845.055288:0:6483:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1789us 00010000:00010000:2.0:1789427845.068130:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068153:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068165:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068181:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068188:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068195:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068302:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068310:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068326:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427845.068352:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789427845.068355:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427845.068662:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068675:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068681:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068689:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068695:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.068700:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068707:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068718:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:2.0:1789427845.068722:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.068727:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068733:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5184d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068756:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068762:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068768:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068773:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.068777:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068782:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068789:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919581d49800) 00010000:00010000:2.0:1789427845.068791:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.068794:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068799:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5184dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068836:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5184cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ae3 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068851:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ae3 expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.068869:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427845.068871:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789427845.068873:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789427845.068982:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:10475:x1876350931588736:12345-192.168.202.24@tcp:101:touch.500 Request processed in 15623us (15883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427845.068990:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:0.0:1789427845.072146:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427845.072234:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931588992 00000100:00100000:3.0:1789427845.072243:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931588992 00000100:00100000:3.0:1789427845.072338:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:3.0:1789427845.072349:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:10475:x1876350931588992:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:3.0:1789427845.072370:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427845.072399:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede5184eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300aea expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072687:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072704:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072716:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072776:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072795:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.072803:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427845.073177:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789427845.073317:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518500 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073326:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073333:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073364:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073499:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073573:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073579:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427845.073583:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073591:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073613:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:3.0:1789427845.073617:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427845.073622:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073629:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5184f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427845.073642:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dcff53fc reply state 000000007a2e461d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073651:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073657:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x80a4fa14 (ffff919688862a00) 00010000:00010000:3.0:1789427845.073660:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427845.073662:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789427845.073694:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede5184eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300aea expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073708:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518500 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300aea expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.073716:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427845.073718:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427845.073720:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ba00, rc 0) 00000100:00100000:3.0:1789427845.073819:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+10:10475:x1876350931588992:12345-192.168.202.24@tcp:101:touch.500 Request processed in 1471us (1681us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789427845.073827:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789427845.077042:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427845.077103:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931589248 00000100:00100000:1.0:1789427845.077112:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931589248 00000100:00100000:1.0:1789427845.077178:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1789427845.077189:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+10:10475:x1876350931589248:12345-192.168.202.24@tcp:36:touch.500 00010000:00010000:1.0:1789427845.077243:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427845.077268:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518500 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300aea expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.077285:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff919688862300) 00010000:00010000:1.0:1789427845.077295:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427845.077345:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.077358:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.077368:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427845.077562:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037515768 reply state 00000000b68e7a66 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.077574:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.077580:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789427845.077582:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427845.077584:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427845.077662:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+11:10475:x1876350931589248:12345-192.168.202.24@tcp:36:touch.500 Request processed in 474us (628us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789427845.077669:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1789427845.080979:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.081057:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931589376 00000100:00100000:2.0:1789427845.081066:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931589376 00000100:00100000:2.0:1789427845.081126:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:2.0:1789427845.081136:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+11:10475:x1876350931589376:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:2.0:1789427845.081168:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427845.081188:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518515 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300af1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.081244:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518515 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af1 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.081257:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518515 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af1 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.081275:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789427845.081279:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427845.081283:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427845.081340:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+12:10475:x1876350931589376:12345-192.168.202.24@tcp:101:touch.500 Request processed in 205us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427845.081360:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1789427845.084716:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427845.084792:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931589504 00000100:00100000:3.0:1789427845.084802:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931589504 00000100:00100000:3.0:1789427845.084851:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789427845.084859:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1876350931589504:12345-192.168.202.24@tcp:8:touch.500 00010000:00080000:3.0:1789427845.084891:0:8902:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1789427845.084919:0:8902:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede51851c 00002000:00100000:3.0:1789427845.084930:0:8902:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f916dfa-5c35-44f7-8247-070d65680205/ffff919583cab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789427845.084947:0:8902:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789427845.085019:0:8902:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789427845.085048:0:8902:0:(import.c:65:import_set_state_nolock()) ffff919583caa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427845.085105:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931589504:12345-192.168.202.24@tcp:8:touch.500 Request processed in 244us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427845.085111:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789427845.087568:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427845.087776:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931589632 00000100:00100000:0.0:1789427845.087785:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931589632 00000100:00100000:0.0:1789427845.087848:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1789427845.087858:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:0:x1876350931589632:12345-192.168.202.24@tcp:2:touch.500 00000100:00080000:2.0:1789427845.090087:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789427845.090283:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1789427845.090294:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000100:00100000:0.0:1789427845.090515:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:0:x1876350931589632:12345-192.168.202.24@tcp:2:touch.500 Request processed in 2653us (2951us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789427845.090539:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:1.0:1789427845.093197:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.094092:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931589888 00000100:00100000:2.0:1789427845.094103:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931589888 00000100:00100000:2.0:1789427845.094168:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1789427845.094180:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+12:10475:x1876350931589888:12345-192.168.202.24@tcp:35:touch.500 00000100:00100000:2.0:1789427845.094775:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+13:10475:x1876350931589888:12345-192.168.202.24@tcp:35:touch.500 Request processed in 595us (1588us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789427845.094783:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1789427845.147984:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427845.148074:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931590016 00000100:00100000:3.0:1789427845.148084:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931590016 00000100:00100000:3.0:1789427845.148143:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1789427845.148154:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+13:10476:x1876350931590016:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1789427845.148178:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427845.148197:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300af8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148260:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148291:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148302:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427845.148345:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789427845.148349:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427845.148385:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148410:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af8 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148478:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af8 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.148487:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:3.0:1789427845.148490:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427845.148494:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a400, rc 0) 00000100:00100000:3.0:1789427845.148556:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+14:10476:x1876350931590016:12345-192.168.202.24@tcp:101:rm.0 Request processed in 405us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427845.148564:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1789427845.153983:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.154244:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931590272 00000100:00100000:2.0:1789427845.154254:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931590272 00000100:00100000:2.0:1789427845.154313:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1789427845.154323:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+14:10476:x1876350931590272:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1789427845.154342:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427845.154361:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300aff expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427845.154489:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789427845.154630:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518531 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300aff expref: 16 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.154643:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:2.0:1789427845.154646:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427845.154651:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300aff expref: 16 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.154675:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789427845.154726:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+15:10476:x1876350931590272:12345-192.168.202.24@tcp:101:rm.0 Request processed in 403us (751us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789427845.154733:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:0.0:1789427845.161108:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.161189:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931590400 00000100:00100000:2.0:1789427845.161200:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931590400 00000100:00100000:2.0:1789427845.161253:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:2.0:1789427845.161262:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+15:10476:x1876350931590400:12345-192.168.202.24@tcp:37:rm.0 00000100:00100000:2.0:1789427845.165475:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+15:10476:x1876350931590400:12345-192.168.202.24@tcp:37:rm.0 Request processed in 4203us (4367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427845.165488:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1789427845.178570:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427845.178895:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931590656 00000100:00100000:0.0:1789427845.178906:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931590656 00000100:00100000:0.0:1789427845.178963:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1789427845.178974:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919690462050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+15:10476:x1876350931590656:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:0.0:1789427845.179243:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919690462050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+16:10476:x1876350931590656:12345-192.168.202.24@tcp:35:rm.0 Request processed in 270us (682us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789427845.179251:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1789427845.189219:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.195977:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931590912 00000100:00100000:2.0:1789427845.195994:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931590912 00000100:00100000:2.0:1789427845.196067:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:2.0:1789427845.196078:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+16:10476:x1876350931590912:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1789427845.196103:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427845.196125:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51853f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b06 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.196228:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede518546 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.196243:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede518546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.196256:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede518546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427845.196282:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789427845.196463:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51853f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b06 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.196481:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede518546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b06 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.196489:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427845.196492:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427845.196496:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428600, rc 0) 00000100:00100000:2.0:1789427845.196568:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931590912:12345-192.168.202.24@tcp:101:rm.0 Request processed in 492us (7358us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789427845.196575:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:1.0:1789427845.200252:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427845.200334:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931591040 00000100:00100000:3.0:1789427845.200343:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931591040 00000100:00100000:3.0:1789427845.200403:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1789427845.200454:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591040:12345-192.168.202.24@tcp:41:rm.0 00000004:00000024:3.0:1789427845.200535:0:8108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789427845.200593:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591040:12345-192.168.202.24@tcp:41:rm.0 Request processed in 180us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427845.200616:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1789427845.203902:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427845.203973:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931591168 00000100:00100000:1.0:1789427845.203983:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931591168 00000100:00100000:1.0:1789427845.204038:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1789427845.204049:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591168:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:1.0:1789427845.204068:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427845.204086:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965600/0x84fc867ede518554 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b0d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204143:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204158:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204181:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204194:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204201:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204207:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204287:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204296:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204302:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427845.204331:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789427845.204335:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427845.204352:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204363:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204371:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204386:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204393:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204399:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427845.204404:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204411:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204473:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427845.204476:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427845.204482:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204492:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51855b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204513:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204520:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204526:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204535:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427845.204544:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204551:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204563:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x80a4fa14 (ffff919688862a00) 00010000:00010000:1.0:1789427845.204566:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427845.204569:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204575:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964a00/0x84fc867ede518562 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204660:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965600/0x84fc867ede518554 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b0d expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204675:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b0d expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427845.204682:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789427845.204684:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427845.204686:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965000, rc 0) 00000100:00100000:1.0:1789427845.204743:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+19:10476:x1876350931591168:12345-192.168.202.24@tcp:101:rm.0 Request processed in 696us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427845.204750:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:0.0:1789427845.208403:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427845.208514:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931591424 00000100:00100000:3.0:1789427845.208523:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931591424 00000100:00100000:3.0:1789427845.208571:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1789427845.208580:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+19:10476:x1876350931591424:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1789427845.208635:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789427845.208659:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965000/0x84fc867ede518569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b0d expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208679:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af1 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208690:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:3.0:1789427845.208700:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede51852a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300af8 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208707:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:3.0:1789427845.208709:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427845.208726:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208735:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208741:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208759:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208764:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208768:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208829:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208834:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.208838:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427845.209024:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789427845.209034:0:6484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189703618921ns, next at 190703616238ns, rc = 0 00010000:00010000:3.0:1789427845.209075:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209084:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209092:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209099:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209115:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209120:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209145:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427845.209161:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209168:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209175:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209180:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427845.209185:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209192:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209196:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427845.209200:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789427845.209202:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209203:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789427845.209207:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209209:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ba00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427845.209212:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209213:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede51857e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209219:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209227:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209227:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789427845.209230:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789427845.209233:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209239:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209246:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209247:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518585 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209251:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427845.209254:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209257:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427845.209258:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427845.209259:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.209260:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427845.209266:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:3.0:1789427845.209268:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427845.209271:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209277:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b600/0x84fc867ede518570 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427845.209286:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec89cd1 reply state 0000000000e730bb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209296:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427845.209302:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x80a4fa14 (ffff919688862a00) 00010000:00010000:3.0:1789427845.209305:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427845.209307:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427845.209371:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591424:12345-192.168.202.24@tcp:36:rm.0 Request processed in 791us (975us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789427845.209385:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:0.0:1789427845.211838:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.211908:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931591680 00000100:00100000:2.0:1789427845.211917:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931591680 00000100:00100000:0.0:1789427845.212277:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789427845.212288:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591680:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:0.0:1789427845.212513:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+19:10476:x1876350931591680:12345-192.168.202.24@tcp:35:rm.0 Request processed in 227us (682us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789427845.212521:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789427845.227490:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427845.227743:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931591936 00000100:00100000:2.0:1789427845.227754:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931591936 00000100:00100000:2.0:1789427845.227817:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789427845.227827:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+19:10476:x1876350931591936:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:2.0:1789427845.227885:0:10064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789427845.227911:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede518546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b06 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.227944:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5184e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ae3 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.227955:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427845.227969:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5184a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ad5 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.227978:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969af6fe00) 00010000:00010000:2.0:1789427845.227983:0:10064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427845.228004:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228033:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228043:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228057:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228064:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228070:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228297:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228306:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228313:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427845.228570:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789427845.228585:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228592:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228599:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228611:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.228615:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228623:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228633:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff919581d49500) 00010000:00010000:2.0:1789427845.228635:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789427845.228639:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228645:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51859a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228721:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228728:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228734:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228739:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427845.228742:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228748:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228766:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d49800) 00010000:00010000:2.0:1789427845.228769:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427845.228772:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228778:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51858c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427845.228789:0:10064:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000057a51366 reply state 000000005bceb178 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228800:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427845.228807:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919581d49600) 00010000:00010000:2.0:1789427845.228809:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789427845.228811:0:10064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427845.228943:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+18:10476:x1876350931591936:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1116us (1535us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789427845.228952:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00010000:00010000:1.0:1789427845.554695:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427845.937848:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940048640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427845.937949:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427845.938001:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048640 00000100:00100000:1.0:1789427845.938033:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048640 00000100:00100000:1.0:1789427845.938113:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789427845.938135:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940048640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427845.938168:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427845.938242:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940048640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427845.938249:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789427845.938523:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940048640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427846.115312:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427846.115356:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427846.115377:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592064 00000100:00100000:3.0:1789427846.115390:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592320 00000100:00100000:0.0:1789427846.115390:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427846.115392:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592064 00000100:00100000:3.0:1789427846.115399:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592320 00000100:00100000:0.0:1789427846.115461:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427846.115499:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427846.115513:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:3.0:1789427846.115528:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931592320:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427846.115532:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592576 00000100:00100000:0.0:1789427846.115546:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592576 00000100:00100000:2.0:1789427846.115562:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 324 00000100:00100000:2.0:1789427846.115572:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931592064:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427846.115601:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592192 00000100:00100000:0.0:1789427846.115605:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592192 00000100:00100000:3.0:1789427846.115626:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931592320:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427846.115634:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592448 00000100:00100000:3.0:1789427846.115635:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:0.0:1789427846.115649:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592448 00000100:00100000:0.0:1789427846.115676:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:3.0:1789427846.115687:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:0.0:1789427846.115688:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931592576:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427846.115702:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931592192:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427846.115713:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931592064:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 141us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.115722:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 324 00000100:00100000:0.0:1789427846.115736:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931592576:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.115744:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931592192:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 44us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427846.115751:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:3.0:1789427846.115760:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00080000:2.0:1789427846.115763:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427846.115775:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00080000:2.0:1789427846.115777:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427846.115786:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931592448:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427846.115814:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931592448:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427846.115820:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:2.0:1789427846.448762:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940049024:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.448828:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.448881:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940049536:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.448901:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.448934:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940050048:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.448950:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.448966:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789427846.448970:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940048896:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.448986:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.448998:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940049408:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449009:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.449018:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940049920:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449035:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427846.449059:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049024 00000100:00100000:2.0:1789427846.449066:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049024 00000100:00100000:2.0:1789427846.449096:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049536 00000100:00100000:2.0:1789427846.449098:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049536 00000100:00100000:2.0:1789427846.449114:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050048 00000100:00100000:2.0:1789427846.449115:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050048 00000100:00100000:2.0:1789427846.449121:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049408 00000100:00100000:2.0:1789427846.449123:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049408 00000100:00100000:2.0:1789427846.449131:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049920 00000100:00100000:2.0:1789427846.449134:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049920 00000100:00100000:2.0:1789427846.449149:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789427846.449156:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940049024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449205:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940049024:12345-0@lo:400:kworker.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449225:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789427846.449238:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789427846.449241:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940049536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449260:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940049536:12345-0@lo:400:kworker.0 Request processed in 19us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449264:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789427846.449270:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789427846.449273:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940050048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449285:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940050048:12345-0@lo:400:kworker.0 Request processed in 13us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449288:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789427846.449293:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789427846.449296:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940049408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449308:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940049408:12345-0@lo:400:kworker.0 Request processed in 12us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449311:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789427846.449317:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789427846.449320:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940049920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449331:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940049920:12345-0@lo:400:kworker.0 Request processed in 11us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449334:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789427846.449346:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048896 00000100:00100000:2.0:1789427846.449348:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048896 00000100:00100000:2.0:1789427846.449363:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789427846.449366:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940048896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449393:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940048896:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427846.449399:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:2.0:1789427846.449454:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427846.449457:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427846.449477:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940048896:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449487:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940049408:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449493:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940049920:0@lo:400:kworker.0 00000100:00100000:2.0:1789427846.449499:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940049024:0@lo:400:kworker.0 00010000:00080000:2.0:1789427846.449507:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583eda300 x1876350940049536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427846.449516:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940049536:0@lo:400:kworker.0 00010000:00080000:2.0:1789427846.449522:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cba300 x1876350940050048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427846.449528:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940050048:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449593:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940048768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427846.449621:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449642:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940049280:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449658:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449670:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940049792:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449685:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449696:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940050304:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449717:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449731:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789427846.449734:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940049152:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449750:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449762:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940049664:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449774:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449784:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940050176:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449797:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427846.449818:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049280 00000100:00100000:3.0:1789427846.449821:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049280 00000100:00100000:3.0:1789427846.449841:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789427846.449846:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940049280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449871:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940049280:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.449875:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789427846.449892:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049792 00000100:00100000:3.0:1789427846.449895:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049792 00000100:00100000:3.0:1789427846.449912:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050304 00000100:00100000:3.0:1789427846.449914:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050304 00000100:00100000:3.0:1789427846.449923:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049664 00000100:00100000:3.0:1789427846.449925:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049664 00000100:00100000:3.0:1789427846.449933:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050176 00000100:00100000:3.0:1789427846.449935:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050176 00000100:00100000:3.0:1789427846.449944:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789427846.449948:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940049792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.449969:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940049792:12345-0@lo:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.449974:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789427846.449987:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789427846.449992:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.450014:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940050304:12345-0@lo:400:kworker.0 Request processed in 21us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.450019:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789427846.450029:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789427846.450035:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940049664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.450058:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940049664:12345-0@lo:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.450064:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789427846.450074:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789427846.450080:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940050176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.450103:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940050176:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.450109:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789427846.450128:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940049152 00000100:00100000:3.0:1789427846.450132:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940049152 00000100:00100000:3.0:1789427846.450155:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789427846.450161:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940049152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.450189:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940049152:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427846.450195:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789427846.450220:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427846.450223:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427846.450237:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940049152:0@lo:400:kworker.0 00010000:00080000:3.0:1789427846.450246:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cb8380 x1876350940049664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427846.450261:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940049664:0@lo:400:kworker.0 00010000:00080000:3.0:1789427846.450271:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940050176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427846.450279:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940050176:0@lo:400:kworker.0 00000100:00100000:3.0:1789427846.450287:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940049280:0@lo:400:kworker.0 00010000:00080000:3.0:1789427846.450295:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cb8700 x1876350940049792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427846.450302:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940049792:0@lo:400:kworker.0 00010000:00080000:3.0:1789427846.450311:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbaa00 x1876350940050304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427846.450318:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940050304:0@lo:400:kworker.0 00000100:00100000:0.0:1789427846.450605:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940050432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427846.450625:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427846.450670:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940048768 00000100:00100000:1.0:1789427846.450673:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940048768 00000100:00100000:1.0:1789427846.450696:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050432 00000100:00100000:1.0:1789427846.450698:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050432 00000100:00100000:1.0:1789427846.450706:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427846.450710:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940048768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427846.450726:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427846.450751:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940048768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427846.450757:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427846.450771:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427846.450776:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940050432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427846.450785:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427846.450808:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940050432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427846.450814:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789427846.450862:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf7b80 x1876350940050432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427846.450872:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940050432:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789427846.450977:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa32300 x1876350940048768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427846.450988:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940048768:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789427846.576575:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789427847.477594:0:8901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 191972175685ns, next at 192972172851ns, rc = 0 00000100:00100000:0.0:1789427847.477606:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427847.478384:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940050688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427847.478497:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427847.478633:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050688 00000100:00100000:1.0:1789427847.478641:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050688 00000100:00100000:1.0:1789427847.478699:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427847.478708:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940050688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427847.478747:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427847.478802:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940050688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427847.478810:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789427847.478931:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf6680 x1876350940050688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427847.478951:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940050688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427847.481293:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940050560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427847.481369:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427847.481551:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050560 00000100:00100000:2.0:1789427847.481559:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050560 00000100:00100000:2.0:1789427847.481601:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789427847.481610:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940050560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427847.481629:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427847.481687:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940050560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427847.481695:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1789427847.481744:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca24000 x1876350940050560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427847.481775:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940050560:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427847.600732:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427848.496798:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427848.496822:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940050816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427848.496909:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427848.498458:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940050816 00000100:00100000:0.0:1789427848.498523:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940050816 00000100:00100000:0.0:1789427848.498577:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789427848.498588:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940050816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427848.498625:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789427848.498695:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940050816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427848.498702:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789427848.499032:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940050816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427848.625548:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427848.786916:0:13642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789427849.649034:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427850.495275:0:13691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbd4dac60 20000000:00000080:0.0:1789427850.495293:0:13691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196ae84ac00 uarg=0000000000000000 20000000:01000000:0.0:1789427850.495335:0:13691:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789427850.495341:0:13691:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789427850.495346:0:13691:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789427850.496150:0:13692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789427850.496285:0:13691:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789427850.499097:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789427850.499132:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789427850.499141:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789427850.499150:0:13691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789427850.499165:0:13691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499178:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51842e expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499183:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51843c expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499195:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499199:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede518458 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499205:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499209:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499213:0:13691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499242:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499253:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 12 pid: 6477 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499262:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940050944:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427850.499332:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499338:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499343:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051072:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427850.499371:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499377:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 23 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499383:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051200:0@lo:104: 00000100:00100000:0.0:1789427850.499580:0:13691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427850.499631:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499640:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499648:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051328:0@lo:104: 00010000:00010000:0.0:1789427850.499672:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499680:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 23 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499689:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051456:0@lo:104: 00010000:00010000:0.0:1789427850.499716:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.499725:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 23 pid: 6475 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.499733:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051584:0@lo:104: 00000100:00100000:0.0:1789427850.499748:0:13691:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929600 going to sleep for 11 seconds 00000100:00100000:2.0:1789427850.499978:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789427850.499996:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427850.500234:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427850.500255:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427850.500264:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051200 00000100:00100000:2.0:1789427850.500269:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051200 00000100:00100000:2.0:1789427850.500306:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051456 00000100:00100000:1.0:1789427850.500306:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051328 00000100:00100000:2.0:1789427850.500310:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051456 00000100:00100000:1.0:1789427850.500313:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051328 00000100:00100000:2.0:1789427850.500324:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051584 00000100:00100000:2.0:1789427850.500328:0:6466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051584 00000100:00100000:1.0:1789427850.500344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789427850.500355:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:13691:x1876350940051200:12345-0@lo:104: 00000100:00100000:2.0:1789427850.500360:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1789427850.500370:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427850.500371:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:13691:x1876350940051456:12345-0@lo:104: 00010000:00010000:2.0:1789427850.500384:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.500469:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427850.500476:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+6:13691:x1876350940051200:12345-0@lo:104: Request processed in 124us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427850.500483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789427850.500487:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051200:0@lo:104: 00000100:00100000:1.0:1789427850.500521:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427850.500529:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:13691:x1876350940051328:12345-0@lo:104: 00010000:00010000:1.0:1789427850.500539:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.500615:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051456:0@lo:104: 00010000:00010000:2.0:1789427850.501099:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789427850.501106:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+5:13691:x1876350940051456:12345-0@lo:104: Request processed in 738us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427850.501112:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789427850.501127:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427850.501133:0:6466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:13691:x1876350940051584:12345-0@lo:104: 00010000:00010000:2.0:1789427850.501142:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501444:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789427850.501450:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501458:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427850.501462:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501471:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427850.501479:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427850.501485:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427850.501511:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501518:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427850.501534:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501542:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede518458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51845f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501552:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427850.501555:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501566:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1789427850.501570:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427850.501573:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501580:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427850.501586:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501589:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:01000000:0.0:1789427850.501592:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789427850.501608:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940051712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427850.501615:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501620:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427850.501626:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501633:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51843c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518443 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501634:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427850.501642:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427850.501645:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501650:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427850.501653:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501658:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940051840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427850.501669:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501674:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789427850.501675:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427850.501680:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789427850.501699:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592704 00000100:00100000:3.0:1789427850.501703:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592704 00010000:00010000:0.0:1789427850.501705:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501710:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427850.501722:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 13 pid: 6477 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501725:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501731:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1e800/0x84fc867ede51844a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518451 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501739:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051712 00010000:00010000:0.0:1789427850.501739:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789427850.501742:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051712 00010000:00010000:0.0:1789427850.501742:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501747:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427850.501750:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.501751:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 24 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501758:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501764:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051840 10000000:00010000:0.0:1789427850.501764:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501766:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051840 00010000:00010000:3.0:1789427850.501773:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 25 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427850.501774:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789427850.501785:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00010000:00010000:0.0:1789427850.501786:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501791:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931592704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427850.501791:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427850.501797:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.501800:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427850.501803:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583428c00/0x84fc867ede51842e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede518435 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.501804:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 13 pid: 6477 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.501814:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 13 pid: 6477 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501815:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427850.501817:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427850.501818:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427850.501828:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427850.501838:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940051968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427850.501857:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931592704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427850.501860:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427850.501864:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789427850.501871:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427850.501875:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940051968 00000100:00100000:0.0:1789427850.501876:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940052096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427850.501877:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940051968 00010000:00010000:3.0:1789427850.501887:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 26 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.501892:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427850.501897:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052096 00000100:00100000:3.0:1789427850.501899:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052096 00010000:00010000:3.0:1789427850.501908:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 27 pid: 6475 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.501915:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883bc00/0x84fc867ede51846d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac7 expref: 12 pid: 6477 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501919:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789427850.501925:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+27:3614:x1876350940051712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427850.501925:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940050944:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427850.501932:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789427850.501934:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051072:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427850.501936:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 27 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.501940:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051328:0@lo:104: 00010000:00010000:3.0:1789427850.501944:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 27 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427850.501946:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1876350940051584:0@lo:104: 00010000:00010000:3.0:1789427850.501953:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428000/0x84fc867ede51845f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede518458 expref: 27 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.501960:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427850.501971:0:13691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.501983:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+26:3614:x1876350940051712:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.501989:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789427850.502000:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427850.502012:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+25:3614:x1876350940051840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427850.502020:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427850.502024:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 25 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502031:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 25 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502041:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428e00/0x84fc867ede518443 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51843c expref: 25 pid: 6477 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502049:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427850.502070:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940051840:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.502076:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427850.502088:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427850.502094:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3615:x1876350940051968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427850.502100:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427850.502104:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502112:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502120:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429000/0x84fc867ede518451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51844a expref: 23 pid: 6478 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502127:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427850.502154:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3615:x1876350940051968:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.502164:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427850.502174:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789427850.502179:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3615:x1876350940052096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427850.502184:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427850.502188:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 21 pid: 6475 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502195:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 21 pid: 6475 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502203:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883aa00/0x84fc867ede518435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51842e expref: 21 pid: 6475 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502211:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427850.502226:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3615:x1876350940052096:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.502231:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427850.502254:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940052096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427850.502261:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940051968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427850.502291:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940051840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427850.502459:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940051712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427850.502463:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427850.502476:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592832 00000100:00100000:3.0:1789427850.502479:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592832 00010000:00010000:3.0:1789427850.502490:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427850.502504:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789427850.502510:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:2397:x1876350931592832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427850.502523:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427850.502527:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502535:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502544:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1ee00/0x84fc867ede518466 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ac0 expref: 12 pid: 6478 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502553:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502561:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502571:0:7887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502578:0:7887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502584:0:7887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502590:0:7887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427850.502594:0:7887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427850.502664:0:7887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.502681:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1789427850.502685:0:7887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427850.502698:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+4:13691:x1876350940051328:12345-0@lo:104: Request processed in 2169us (2699us total) trans 0 rc 0/0 00010000:00010000:3.0:1789427850.502702:0:7887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.502707:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427850.502709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1789427850.502715:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427850.502718:0:13691:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.502725:0:13691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427850.502732:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1ea00/0x84fc867ede5185a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.502736:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427850.502741:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2397:x1876350931592832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 229us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.502749:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00010000:00010000:2.0:1789427850.503360:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789427850.503367:0:6466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+3:13691:x1876350940051584:12345-0@lo:104: Request processed in 2234us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427850.503373:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789427850.503732:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789427850.504294:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789427850.504323:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789427850.504331:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789427850.504457:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504474:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504481:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504485:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427850.504489:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504495:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504506:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x80a4fa14 (ffff919688862a00) 00000100:00100000:1.0:1789427850.504550:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940052224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789427850.504582:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427850.504614:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052224 00000100:00100000:1.0:1789427850.504619:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052224 00010000:00010000:2.0:1789427850.504770:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427850.504777:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504783:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5184f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504796:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504802:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504808:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504812:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427850.504819:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504826:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504834:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789427850.504836:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427850.504839:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504845:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51850e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504859:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504864:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504869:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504874:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ac00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427850.504877:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504883:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504888:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x80a4fa14 (ffff919688862a00) 00010000:00010000:2.0:1789427850.504891:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427850.504897:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504903:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518577 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x80a4fa14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504916:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504922:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504928:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504934:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427850.504936:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504942:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504951:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919581d49600) 00010000:00010000:2.0:1789427850.504953:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427850.504956:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.504961:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518593 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427850.505029:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427850.505038:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940052224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789427850.505057:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789427850.505082:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa88084, atime: 0x6aa88084, ctime: 0x6aa88084, blocks: 0x0 00010000:00010000:1.0:1789427850.505088:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.505101:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=194s v=(0 0) 00010000:00010000:1.0:1789427850.505104:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427850.505108:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.505118:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.505123:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.505135:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427850.505153:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789427850.505274:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940052224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 238us (690us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789427850.505282:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789427850.505290:0:3613:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919583cf6680/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789427850.505295:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940052224:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789427850.505298:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789427850.505328:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427850.505333:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.505351:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427850.505355:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.505363:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.505375:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.505382:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede5185a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427850.505406:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427850.505408:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427850.505410:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427850.672604:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427851.056632:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427851.056655:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940052352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427851.056721:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.056781:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052352 00000100:00100000:2.0:1789427851.056788:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052352 00000100:00100000:2.0:1789427851.056828:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789427851.056837:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940052352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427851.056871:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427851.056915:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940052352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.056928:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789427851.056976:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940052352:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1789427851.196526:0:13740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffce1ecd10 20000000:00000080:2.0:1789427851.196544:0:13740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196bcb51c00 uarg=0000000000000000 20000000:01000000:2.0:1789427851.196599:0:13740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789427851.196606:0:13740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789427851.196611:0:13740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1789427851.197051:0:13741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1789427851.197212:0:13740:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1789427851.197298:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1789427851.197408:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1789427851.197533:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1789427851.197546:0:13740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789427851.197567:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197584:0:13740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197597:0:13740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197604:0:13740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197611:0:13740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197619:0:13740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197638:0:13740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427851.197643:0:13740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197651:0:13740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197665:0:13740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197673:0:13740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.197681:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429400/0x84fc867ede5185af lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427851.262987:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427851.263035:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427851.263059:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931592960 00000100:00100000:0.0:1789427851.263071:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931592960 00000100:00100000:0.0:1789427851.263137:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 326 00000100:00100000:0.0:1789427851.263149:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2395:x1876350931592960:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427851.263230:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2395:x1876350931592960:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427851.263237:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 326 00000100:00100000:3.0:1789427851.263459:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427851.263597:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593088 00000100:00100000:2.0:1789427851.263603:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593088 00000100:00100000:2.0:1789427851.263652:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593216 00000100:00100000:2.0:1789427851.263656:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593216 00000100:00100000:3.0:1789427851.263660:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427851.263686:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:3.0:1789427851.263692:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427851.263697:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593088:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427851.263721:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427851.263738:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593472 00000100:00100000:3.0:1789427851.263742:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593472 00000100:00100000:3.0:1789427851.263761:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593600 00000100:00100000:3.0:1789427851.263764:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593600 00000100:00100000:3.0:1789427851.263777:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:3.0:1789427851.263784:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593216:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427851.263898:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593088:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 204us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.263905:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:2.0:1789427851.263920:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:2.0:1789427851.263926:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931593472:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427851.265461:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593216:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1662us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.265474:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:3.0:1789427851.265501:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:3.0:1789427851.265521:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931593600:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427851.265557:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931593600:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 50us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.265564:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:3.0:1789427851.266172:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593344 00000100:00100000:3.0:1789427851.266180:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593344 00000100:00100000:3.0:1789427851.266229:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1789427851.266238:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593344:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427851.266300:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931593472:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 2371us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.266310:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00080000:2.0:1789427851.266334:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427851.266338:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427851.266341:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427851.270330:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931593344:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 4080us (6660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.270356:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:2.0:1789427851.568694:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940052736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.568800:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.568857:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940053248:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.568885:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.568907:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940053760:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.568929:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.568952:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789427851.568959:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940052864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.568978:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.569001:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940053376:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.569024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.569040:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940053888:0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.569058:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.569093:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052736 00000100:00100000:2.0:1789427851.569101:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052736 00000100:00100000:2.0:1789427851.569142:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789427851.569151:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940052736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.569203:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940052736:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.569230:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789427851.569253:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053248 00000100:00100000:2.0:1789427851.569257:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053248 00000100:00100000:2.0:1789427851.569287:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053760 00000100:00100000:2.0:1789427851.569290:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053760 00000100:00100000:2.0:1789427851.569306:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052864 00000100:00100000:2.0:1789427851.569309:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052864 00000100:00100000:2.0:1789427851.569321:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789427851.569327:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940053248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.569359:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940053248:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.569365:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789427851.569377:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789427851.569477:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940052608:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569508:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569522:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940053120:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569542:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569551:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940053632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569569:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569586:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789427851.569592:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940052480:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569617:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569647:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940052992:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569671:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569689:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940053504:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569726:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569746:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940054016:0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569768:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.569799:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052608 00000100:00100000:3.0:1789427851.569802:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052608 00000100:00100000:3.0:1789427851.569820:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053120 00000100:00100000:3.0:1789427851.569823:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053120 00000100:00100000:3.0:1789427851.569835:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053632 00000100:00100000:3.0:1789427851.569837:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053632 00000100:00100000:3.0:1789427851.569849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789427851.569855:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940052864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569886:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940052864:12345-0@lo:400:kworker.0 Request processed in 30us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.569892:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789427851.569904:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789427851.569910:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569947:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940052608:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.569952:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789427851.569966:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789427851.569972:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940053120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.569999:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940053120:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.570013:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789427851.570026:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789427851.570032:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940053632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.570061:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940053632:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.570066:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789427851.570123:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052480 00000100:00100000:3.0:1789427851.570127:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052480 00000100:00100000:3.0:1789427851.570151:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789427851.570158:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3616:x1876350940052480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.570184:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3616:x1876350940052480:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.570190:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789427851.570215:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940052992 00000100:00100000:3.0:1789427851.570219:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940052992 00000100:00100000:3.0:1789427851.570240:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427851.570245:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940052992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427851.570273:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940052992:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.570278:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427851.570299:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053376 00000100:00100000:3.0:1789427851.570303:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053376 00000100:00100000:3.0:1789427851.570321:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053888 00000100:00100000:3.0:1789427851.570324:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053888 00000100:00100000:3.0:1789427851.570335:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940053504 00000100:00100000:3.0:1789427851.570337:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940053504 00000100:00100000:3.0:1789427851.570346:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054016 00000100:00100000:3.0:1789427851.570354:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054016 00000100:00100000:3.0:1789427851.570371:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789427851.570377:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940053376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789427851.572555:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427851.572563:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427851.572567:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427851.572570:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427851.572608:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789427851.572625:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940053888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.572700:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940053888:12345-0@lo:400:kworker.0 Request processed in 82us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427851.572707:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789427851.572731:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789427851.572738:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940053504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.572771:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940053504:12345-0@lo:400:kworker.0 Request processed in 34us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427851.572777:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789427851.572789:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427851.572795:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940054016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.572823:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940054016:12345-0@lo:400:kworker.0 Request processed in 28us (3054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427851.572829:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427851.572877:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940052864:0@lo:400:kworker.0 00010000:00080000:0.0:1789427851.572892:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ed9880 x1876350940053888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427851.572903:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940053888:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.572913:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940052736:0@lo:400:kworker.0 00010000:00080000:0.0:1789427851.572924:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583edbb80 x1876350940053248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427851.572932:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940053248:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.572991:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940054144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427851.573035:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427851.573074:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940052480:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573086:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940052992:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573097:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940053504:0@lo:400:kworker.0 00010000:00080000:0.0:1789427851.573107:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f9880 x1876350940054016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427851.573116:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940054016:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573128:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940052608:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573139:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940053120:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573152:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940053632:0@lo:400:kworker.0 00000100:00100000:0.0:1789427851.573217:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054144 00000100:00100000:0.0:1789427851.573223:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054144 00000100:00100000:0.0:1789427851.573254:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789427851.573261:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940054144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427851.573283:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427851.573318:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940054144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427851.573324:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1789427851.573352:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e26a00 x1876350940054144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427851.573367:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940054144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427851.573560:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427851.573569:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940054272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427851.573598:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.573628:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054272 00000100:00100000:1.0:1789427851.573633:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054272 00000100:00100000:1.0:1789427851.573657:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427851.573664:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940054272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427851.573674:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427851.573704:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940054272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.573710:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789427851.573739:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf4700 x1876350940054272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427851.573753:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940054272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427851.573887:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940053760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427851.573988:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940053760:12345-0@lo:400:kworker.0 Request processed in 4605us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.573996:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789427851.574096:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940053376:12345-0@lo:400:kworker.0 Request processed in 3718us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.574104:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789427851.574279:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ed9180 x1876350940053760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427851.574304:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940053760:0@lo:400:kworker.0 00000100:00100000:1.0:1789427851.574324:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940053376:0@lo:400:kworker.0 10000000:01000000:0.0:1789427851.632551:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789427851.632576:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8a000 from 7 10000000:01000000:0.0:1789427851.632582:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427851.632629:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427851.632643:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427851.632654:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427851.632681:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427851.632752:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427851.632892:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.633087:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054400 00000100:00100000:1.0:1789427851.633096:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054400 00000100:00100000:1.0:1789427851.633191:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789427851.633202:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:6481:x1876350940054400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427851.633216:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427851.633228:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965600/0x84fc867ede5185bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5185b6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.633251:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965600/0x84fc867ede5185bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5185b6 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.633262:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965600/0x84fc867ede5185bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5185b6 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.633271:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965600, rc 0) 00000100:00100000:1.0:1789427851.633320:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940054400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.633327:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789427851.633456:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427851.633471:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427851.633480:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427851.633541:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427851.633566:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427851.633779:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427851.633850:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054528 00000100:00100000:3.0:1789427851.633855:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054528 00000100:00100000:3.0:1789427851.633881:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789427851.633888:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940054528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427851.634010:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940054528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.634018:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789427851.634091:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427851.634118:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427851.634162:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427851.634189:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.634239:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054656 00000100:00100000:1.0:1789427851.634244:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054656 00000100:00100000:1.0:1789427851.634263:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789427851.634269:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940054656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.634563:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940054656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.634580:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789427851.634685:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940054656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.635021:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13753:1876350940054784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.635056:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.635135:0:13753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789427851.635375:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054784 00000100:00100000:3.0:1789427851.635380:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054784 00000100:00100000:3.0:1789427851.635547:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789427851.635555:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:13753:x1876350940054784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427851.635646:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:13753:x1876350940054784:12345-0@lo:502:llog_process_th.0 Request processed in 91us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.635654:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789427851.635720:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13753:1876350940054784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427851.635741:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427851.635750:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427851.635753:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789427851.635761:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bcc8a000 00000020:00000080:2.0:1789427851.635765:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789427851.635833:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427851.635837:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427851.635839:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789427851.635842:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427851.635845:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427851.635846:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789427851.635850:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bcc8a000 00000020:00000080:2.0:1789427851.635852:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789427851.635889:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13753:1876350940054912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.635922:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.641453:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940054912 00000100:00100000:1.0:1789427851.641466:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940054912 00000100:00100000:1.0:1789427851.641512:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789427851.641521:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:13753:x1876350940054912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.641664:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:13753:x1876350940054912:12345-0@lo:502:llog_process_th.0 Request processed in 144us (5741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.641672:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789427851.641748:0:13753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.641772:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13753:1876350940054912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.641803:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.641810:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.641813:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789427851.641819:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789427851.641944:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789427851.641964:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427851.641973:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.641986:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427851.641997:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427851.642000:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bc9e1800 from 7 10000000:01000000:1.0:1789427851.642002:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427851.642032:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642055:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642065:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427851.642086:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642119:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.642134:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919690fda480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.642146:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055040 00000100:00100000:1.0:1789427851.642150:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055040 00000100:00100000:1.0:1789427851.642166:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789427851.642173:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:6481:x1876350940055040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427851.642182:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427851.642193:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965000/0x84fc867ede5185cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5185c4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642214:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965000/0x84fc867ede5185cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5185c4 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642225:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965000/0x84fc867ede5185cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5185c4 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642233:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965000, rc 0) 00000100:00100000:1.0:1789427851.642265:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.642271:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789427851.642309:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427851.642321:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.642331:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427851.642506:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642539:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.642554:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.642565:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055168 00000100:00100000:1.0:1789427851.642568:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055168 00000100:00100000:1.0:1789427851.642584:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789427851.642590:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642676:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.642684:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789427851.642714:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642738:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642770:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.642784:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.642795:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055296 00000100:00100000:1.0:1789427851.642800:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055296 00000100:00100000:1.0:1789427851.642819:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789427851.642825:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.642886:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.642899:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789427851.642933:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.643071:0:13756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13756:1876350940055424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.643102:0:13756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.643120:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055424 00000100:00100000:1.0:1789427851.643123:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055424 00000100:00100000:1.0:1789427851.643140:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789427851.643146:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:13756:x1876350940055424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.643210:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:13756:x1876350940055424:12345-0@lo:502:llog_process_th.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.643217:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789427851.643243:0:13756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196989293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.643253:0:13756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13756:1876350940055424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.643271:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.643277:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.643279:0:13756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.643286:0:13756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bc9e1800 00000020:00000080:1.0:1789427851.643288:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789427851.643339:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.644736:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.644740:0:13756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.644747:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.644751:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.644753:0:13756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789427851.644757:0:13756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bc9e1800 00000020:00000080:1.0:1789427851.644760:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427851.645525:0:13756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13756:1876350940055552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.645579:0:13756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.645611:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055552 00000100:00100000:1.0:1789427851.645619:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055552 00000100:00100000:1.0:1789427851.645651:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789427851.645659:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:13756:x1876350940055552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.645741:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:13756:x1876350940055552:12345-0@lo:502:llog_process_th.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.645749:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789427851.645795:0:13756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196989293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.645813:0:13756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13756:1876350940055552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.645834:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.645838:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.645840:0:13756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789427851.645844:0:13756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789427851.645898:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789427851.645915:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427851.645925:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.645937:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427851.645947:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427851.645950:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196adadd000 from 7 10000000:01000000:1.0:1789427851.645952:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427851.645972:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.645990:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427851.646000:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427851.646013:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.646037:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.646053:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196989293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.646521:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055680 00000100:00100000:2.0:1789427851.646526:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055680 00000100:00100000:2.0:1789427851.646556:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789427851.646564:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:6481:x1876350940055680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427851.646573:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427851.646587:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428600/0x84fc867ede5185d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5185d2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.646607:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428600/0x84fc867ede5185d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5185d2 expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.646619:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428600/0x84fc867ede5185d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5185d2 expref: 23 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.646628:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428600, rc 0) 00000100:00100000:2.0:1789427851.646663:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940055680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.646669:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789427851.646699:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427851.646720:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.646730:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427851.646780:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.646805:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.646823:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.646833:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055808 00000100:00100000:2.0:1789427851.646837:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055808 00000100:00100000:2.0:1789427851.646853:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789427851.646858:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940055808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.646946:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940055808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.646953:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789427851.646979:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.647003:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.647035:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.647047:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.647058:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940055936 00000100:00100000:2.0:1789427851.647061:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940055936 00000100:00100000:2.0:1789427851.647076:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789427851.647082:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940055936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.647148:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940055936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.647163:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789427851.647197:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940055936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.648882:0:13757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13757:1876350940056064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.648934:0:13757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.649558:0:13757:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427851.649616:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056064 00000100:00100000:3.0:1789427851.649624:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056064 00000100:00100000:3.0:1789427851.649667:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789427851.649675:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:13757:x1876350940056064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427851.649848:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:13757:x1876350940056064:12345-0@lo:502:llog_process_th.0 Request processed in 173us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.649864:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789427851.652097:0:13757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13757:1876350940056064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.652136:0:13757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.652145:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.652148:0:13757:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.652158:0:13757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196adadd000 00000020:00000080:1.0:1789427851.652161:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789427851.652220:0:13757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.652224:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.652225:0:13757:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.652228:0:13757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.652231:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.652232:0:13757:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789427851.652236:0:13757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196adadd000 00000020:00000080:1.0:1789427851.652239:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427851.652284:0:13757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13757:1876350940056192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.652345:0:13757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.652401:0:13757:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.652848:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056192 00000100:00100000:2.0:1789427851.652855:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056192 00000100:00100000:2.0:1789427851.652906:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789427851.652915:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:13757:x1876350940056192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.653027:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:13757:x1876350940056192:12345-0@lo:502:llog_process_th.0 Request processed in 113us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.653035:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789427851.653200:0:13757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13757:1876350940056192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.653228:0:13757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.653233:0:13757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.653235:0:13757:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789427851.653240:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789427851.653446:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789427851.653464:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427851.653472:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.653484:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427851.653494:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427851.653496:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919684ed8800 from 7 10000000:01000000:2.0:1789427851.653498:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427851.653522:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.653530:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.653548:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427851.653564:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.653595:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427851.653679:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056320 00000100:00100000:3.0:1789427851.653685:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056320 00000100:00100000:3.0:1789427851.653717:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789427851.653725:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:6481:x1876350940056320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427851.653735:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427851.653748:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883b600/0x84fc867ede5185e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5185e0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427851.653771:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883b600/0x84fc867ede5185e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5185e0 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427851.653781:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883b600/0x84fc867ede5185e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5185e0 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427851.653790:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b600, rc 0) 00000100:00100000:2.0:1789427851.654073:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427851.654240:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940056320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 515us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.654247:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789427851.654344:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427851.654356:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.654367:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427851.654564:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.654591:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427851.654615:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789427851.654659:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056448 00000100:00100000:1.0:1789427851.654664:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056448 00000100:00100000:1.0:1789427851.654743:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789427851.654751:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940056448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.654850:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940056448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427851.654858:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789427851.654941:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.654968:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427851.655003:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789427851.655538:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789427851.657585:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427851.659948:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056576 00000100:00100000:3.0:1789427851.659961:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056576 00000100:00100000:3.0:1789427851.660008:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789427851.660017:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940056576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427851.660170:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:6481:x1876350940056576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (5165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427851.660177:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789427851.660225:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:6481:1876350940056576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427851.660626:0:13760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13760:1876350940056704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.663090:0:13760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.663135:0:13760:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.663351:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056704 00000100:00100000:2.0:1789427851.663360:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056704 00000100:00100000:2.0:1789427851.663435:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789427851.663517:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:13760:x1876350940056704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.664507:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:13760:x1876350940056704:12345-0@lo:502:llog_process_th.0 Request processed in 992us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.664516:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789427851.664626:0:13760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13760:1876350940056704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.664658:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.664668:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.664671:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.664680:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919684ed8800 00000020:00000080:1.0:1789427851.664683:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789427851.664751:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.664754:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.664756:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427851.664758:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427851.664761:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.664762:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789427851.664766:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919684ed8800 00000020:00000080:1.0:1789427851.664768:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427851.664822:0:13760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13760:1876350940056832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427851.664868:0:13760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427851.664904:0:13760:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427851.664955:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056832 00000100:00100000:2.0:1789427851.664960:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056832 00000100:00100000:2.0:1789427851.664987:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789427851.664994:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:13760:x1876350940056832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427851.665084:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:13760:x1876350940056832:12345-0@lo:502:llog_process_th.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427851.665091:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789427851.665163:0:13760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:13760:1876350940056832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427851.665181:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427851.665185:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427851.665186:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789427851.665190:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789427851.665353:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789427851.665379:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427851.666439:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427851.666524:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427851.672782:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789427851.697371:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427852.451004:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427852.451067:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593728 00000100:00100000:1.0:1789427852.451075:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593728 00000100:00100000:1.0:1789427852.451115:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 348 00000100:00100000:1.0:1789427852.451122:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:6156:x1876350931593728:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427852.451134:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427852.451151:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964a00/0x84fc867ede5185ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b14 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427852.451178:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964a00/0x84fc867ede5185ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b14 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427852.451189:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964a00/0x84fc867ede5185ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b14 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427852.451198:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964a00, rc 0) 00000100:00100000:1.0:1789427852.451243:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931593728:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 122us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.451247:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 348 00000100:00100000:2.0:1789427852.452139:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427852.452188:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593856 00000100:00100000:3.0:1789427852.452205:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593856 00000100:00100000:3.0:1789427852.452234:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 349 00000100:00100000:3.0:1789427852.452241:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931593856:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427852.452337:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931593856:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 96us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427852.452345:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 349 00000100:00100000:0.0:1789427852.453052:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427852.453100:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931593984 00000100:00100000:1.0:1789427852.453105:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931593984 00000100:00100000:1.0:1789427852.453138:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 350 00000100:00100000:1.0:1789427852.453148:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931593984:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427852.453235:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931593984:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.453242:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 350 00000100:00100000:2.0:1789427852.454242:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427852.454282:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594112 00000100:00100000:3.0:1789427852.454288:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594112 00000100:00100000:3.0:1789427852.454362:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 351 00000100:00100000:3.0:1789427852.454371:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:10761:x1876350931594112:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789427852.454492:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:10761:x1876350931594112:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427852.454499:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 351 00000100:00100000:2.0:1789427852.455286:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427852.455335:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594240 00000100:00100000:1.0:1789427852.455340:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594240 00000100:00100000:1.0:1789427852.455368:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 352 00000100:00100000:1.0:1789427852.455393:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:10761:x1876350931594240:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427852.455494:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:10761:x1876350931594240:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.455503:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 352 00000100:00100000:0.0:1789427852.456312:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427852.456354:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594368 00000100:00100000:3.0:1789427852.456411:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594368 00000100:00100000:3.0:1789427852.456472:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 353 00000100:00100000:3.0:1789427852.456480:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:6156:x1876350931594368:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427852.456490:0:6475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427852.456504:0:6475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91968883aa00/0x84fc867ede5185f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b1b expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427852.456528:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91968883aa00/0x84fc867ede5185f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b1b expref: 13 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427852.456540:0:6475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91968883aa00/0x84fc867ede5185f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b1b expref: 13 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427852.456560:0:6475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883aa00, rc 0) 00000100:00100000:3.0:1789427852.456596:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931594368:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427852.456603:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 353 00000100:00100000:2.0:1789427852.457221:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427852.457261:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594496 00000100:00100000:1.0:1789427852.457266:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594496 00000100:00100000:1.0:1789427852.457286:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 354 00000100:00100000:1.0:1789427852.457291:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931594496:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427852.457366:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931594496:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.457373:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 354 00000100:00100000:0.0:1789427852.458073:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427852.458278:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594624 00000100:00100000:2.0:1789427852.458282:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594624 00000100:00100000:2.0:1789427852.458308:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 355 00000100:00100000:2.0:1789427852.458316:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931594624:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427852.458405:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:6156:x1876350931594624:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427852.458439:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 355 00000100:00100000:0.0:1789427852.459339:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427852.459438:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594752 00000100:00100000:1.0:1789427852.459443:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594752 00000100:00100000:1.0:1789427852.459471:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 356 00000100:00100000:1.0:1789427852.459480:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:10764:x1876350931594752:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427852.459588:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:10764:x1876350931594752:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.459604:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 356 00000100:00100000:3.0:1789427852.460441:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427852.460494:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931594880 00000100:00100000:2.0:1789427852.460499:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931594880 00000100:00100000:2.0:1789427852.460524:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 357 00000100:00100000:2.0:1789427852.460532:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:10764:x1876350931594880:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427852.460598:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:10764:x1876350931594880:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427852.460605:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 357 00000100:00100000:3.0:1789427852.592644:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427852.592651:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427852.592719:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427852.592758:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427852.592786:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057088 00000100:00100000:0.0:1789427852.592796:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057088 00000100:00100000:2.0:1789427852.592816:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940056960 00000100:00100000:2.0:1789427852.592822:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940056960 00000100:00100000:0.0:1789427852.592841:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789427852.592850:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427852.592869:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789427852.592880:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789427852.592881:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427852.592882:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940056960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427852.592899:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427852.592953:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940056960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427852.592955:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427852.592967:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789427852.592974:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789427852.592993:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196adb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427852.592994:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057088:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789427852.656939:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427852.720612:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427852.721178:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789427853.616742:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427853.620486:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427853.620588:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427853.621443:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057216 00000100:00100000:3.0:1789427853.621453:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057216 00000100:00100000:3.0:1789427853.621504:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789427853.621513:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969047e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427853.621542:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427853.621600:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969047e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427853.621608:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789427853.621910:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057216:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789427853.744594:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427854.768566:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427855.792720:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427856.176694:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940057344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427856.176873:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427856.176932:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057344 00000100:00100000:2.0:1789427856.176949:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057344 00000100:00100000:2.0:1789427856.177014:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427856.177023:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940057344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427856.177059:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427856.177129:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940057344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427856.177138:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789427856.177210:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940057344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427856.355225:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427856.355276:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427856.355304:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427856.355311:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595008 00000100:00100000:1.0:1789427856.355328:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595008 00000100:00100000:0.0:1789427856.355367:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427856.355381:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595136 00000100:00100000:2.0:1789427856.355386:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595136 00000100:00100000:1.0:1789427856.355404:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 358 00000100:00100000:0.0:1789427856.355410:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427856.355451:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931595008:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427856.355537:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931595008:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 121us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.355546:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 358 00000100:00100000:2.0:1789427856.355575:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595264 00000100:00100000:2.0:1789427856.355595:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595264 00000100:00100000:2.0:1789427856.355619:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595520 00000100:00100000:2.0:1789427856.355622:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595520 00000100:00100000:2.0:1789427856.355642:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:2.0:1789427856.355652:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931595136:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427856.355694:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931595136:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 46us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.355702:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427856.355707:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:1.0:1789427856.355717:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595648 00000100:00100000:2.0:1789427856.355726:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:2.0:1789427856.355733:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931595264:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427856.355733:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595648 00000100:00100000:0.0:1789427856.355756:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:2.0:1789427856.355769:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931595264:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 37us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427856.355781:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:0.0:1789427856.355783:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931595520:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427856.355796:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:2.0:1789427856.355803:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931595648:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427856.355823:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931595520:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427856.355837:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931595648:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.355837:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:2.0:1789427856.355850:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:2.0:1789427856.355878:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595392 00000100:00100000:2.0:1789427856.355882:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595392 00000100:00080000:0.0:1789427856.355910:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427856.355918:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427856.355921:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00080000:0.0:1789427856.355923:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427856.355934:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931595392:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427856.355981:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931595392:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 53us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427856.355988:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:1.0:1789427856.688702:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427856.688797:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940057728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427856.688811:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.688873:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.688895:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940058112:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.688920:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940058368:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.688936:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.688969:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.688998:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940058624:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.689003:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940058880:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.689052:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.689061:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.689088:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789427856.689102:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940059136:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.689103:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940057600:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.689154:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.689187:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789427856.689195:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.689199:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940057856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.689235:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.689253:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940057984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.689265:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940058240:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.689308:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.689326:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057472 00000100:00100000:1.0:1789427856.689350:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057472 00000100:00100000:0.0:1789427856.689371:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940058496:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.689456:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427856.689477:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057728 00000100:00100000:1.0:1789427856.689485:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057728 00000100:00100000:0.0:1789427856.689497:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940059008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.689516:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789427856.689530:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057472:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427856.689545:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.689594:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057600 00002000:00000024:1.0:1789427856.689595:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427856.689607:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057600 00000100:00100000:1.0:1789427856.689688:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940057472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.689693:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789427856.689704:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427856.689724:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940057600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.689749:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427856.689763:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940057728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427856.689786:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427856.689826:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940057600:12345-0@lo:400:kworker.0 Request processed in 105us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.689838:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789427856.689857:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940057728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.689878:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789427856.689915:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058112 00000100:00100000:0.0:1789427856.689923:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058112 00000100:00100000:1.0:1789427856.689924:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058624 00000100:00100000:1.0:1789427856.689934:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058624 00000100:00100000:0.0:1789427856.689982:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058368 00000100:00100000:1.0:1789427856.689987:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059136 00000100:00100000:1.0:1789427856.689992:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059136 00000100:00100000:0.0:1789427856.689992:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058368 00000100:00100000:1.0:1789427856.690038:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789427856.690046:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690056:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058880 00000100:00100000:0.0:1789427856.690065:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058880 00000100:00100000:1.0:1789427856.690089:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940058624:12345-0@lo:400:kworker.0 Request processed in 42us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.690097:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427856.690099:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057856 00000100:00100000:0.0:1789427856.690106:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057856 00000100:00100000:1.0:1789427856.690113:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789427856.690125:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940059136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690140:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058496 00000100:00100000:0.0:1789427856.690145:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058496 00000100:00100000:1.0:1789427856.690149:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940059136:12345-0@lo:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.690155:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789427856.690192:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059008 00000100:00100000:0.0:1789427856.690200:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059008 00000100:00100000:1.0:1789427856.690201:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789427856.690219:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690244:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789427856.690261:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940058368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690270:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940058112:12345-0@lo:400:kworker.0 Request processed in 52us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.690278:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789427856.690304:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789427856.690317:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690325:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940058368:12345-0@lo:400:kworker.0 Request processed in 69us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.690333:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789427856.690393:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789427856.690393:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940058880:12345-0@lo:400:kworker.0 Request processed in 73us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.690407:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789427856.690446:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940057856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690451:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789427856.690458:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940058496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690483:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1789427856.690484:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427856.690491:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427856.690495:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427856.690495:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940059008:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789427856.690499:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427856.690508:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940057856:12345-0@lo:400:kworker.0 Request processed in 98us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427856.690521:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940057984 00000100:00100000:2.0:1789427856.690521:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789427856.690529:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940057984 00000100:00100000:0.0:1789427856.690531:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940058496:12345-0@lo:400:kworker.0 Request processed in 76us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.690545:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789427856.690554:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940059008:12345-0@lo:400:kworker.0 Request processed in 60us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.690565:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789427856.690600:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427856.690624:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940057600:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690636:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940058752:0@lo:400:kworker.0 00000100:00100000:2.0:1789427856.690650:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058240 00010000:00080000:0.0:1789427856.690655:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f9880 x1876350940058496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427856.690658:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789427856.690658:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058240 00000100:00100000:3.0:1789427856.690676:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940057984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690677:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427856.690695:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789427856.690705:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940059264:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690718:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940058496:0@lo:400:kworker.0 00000100:00100000:2.0:1789427856.690719:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690737:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427856.690756:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583eda300 x1876350940059008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427856.690771:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940059008:0@lo:400:kworker.0 00000100:00100000:3.0:1789427856.690781:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940057984:12345-0@lo:400:kworker.0 Request processed in 103us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427856.690789:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940058624:0@lo:400:kworker.0 00000100:00100000:2.0:1789427856.690793:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940058240:12345-0@lo:400:kworker.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427856.690797:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789427856.690812:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cf4e00 x1876350940057728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427856.690813:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1789427856.690816:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583edbb80 x1876350940059136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427856.690855:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940059136:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690866:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940057728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789427856.690874:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e25180 x1876350940057472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427856.690895:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940057472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427856.690900:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940058368:0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.690935:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940058880:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.690938:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940058112:0@lo:400:kworker.0 00000100:00100000:3.0:1789427856.690979:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940058752 00000100:00100000:3.0:1789427856.690984:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940058752 00000100:00100000:0.0:1789427856.691026:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940057984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.691043:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940057856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427856.691059:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940058240:0@lo:400:kworker.0 00000100:00080000:3.0:1789427856.691075:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427856.691089:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059264 00000100:00100000:0.0:1789427856.691096:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059264 00000100:00100000:2.0:1789427856.691144:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789427856.691158:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427856.691185:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789427856.691196:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940059264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427856.691214:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940058752:12345-0@lo:400:kworker.0 Request processed in 58us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427856.691223:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789427856.691251:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940059264:12345-0@lo:400:kworker.0 Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427856.691260:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000001:00080000:3.0:1789427856.691485:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789427856.692562:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940058752:0@lo:400:kworker.0 00010000:00080000:1.0:1789427856.692575:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ed9880 x1876350940059264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427856.692593:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940059264:0@lo:400:kworker.0 00010000:00010000:1.0:1789427856.816595:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427857.712614:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940059392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427857.712691:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427857.712726:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059392 00000100:00100000:1.0:1789427857.712734:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059392 00000100:00100000:0.0:1789427857.712755:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940059520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427857.712778:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789427857.712789:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940059392:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427857.712793:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789427857.712813:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427857.712849:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059520 00000100:00100000:3.0:1789427857.712854:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059520 00000100:00100000:1.0:1789427857.712870:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940059392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427857.712879:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427857.712890:0:3613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:3.0:1789427857.712891:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000004:00080000:0.0:1789427857.712900:0:3613:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919583cf6680, transno 4294967301 00000100:00100000:3.0:1789427857.712905:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940059520:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427857.712917:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940059392:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427857.712918:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427857.712977:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940059520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427857.712985:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789427857.713014:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940059520:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427857.840543:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427858.736664:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940059648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427858.736734:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427858.737025:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059648 00000100:00100000:3.0:1789427858.737033:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059648 00000100:00100000:3.0:1789427858.737076:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789427858.737086:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940059648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427858.737117:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427858.737166:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940059648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427858.737173:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789427858.737268:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940059648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427858.864662:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427859.889741:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427860.912842:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427861.298214:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427861.298995:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940059776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427861.299065:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427861.299500:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059776 00000100:00100000:1.0:1789427861.299509:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059776 00000100:00100000:1.0:1789427861.299565:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789427861.299575:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940059776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427861.299644:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427861.299792:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940059776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 218us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427861.299800:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789427861.300069:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940059776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427861.484494:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484559:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484586:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484622:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484637:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484656:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427861.484682:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595776 00000100:00100000:3.0:1789427861.484689:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931595904 00000100:00100000:0.0:1789427861.484691:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595776 00000100:00100000:3.0:1789427861.484702:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931595904 00000100:00100000:3.0:1789427861.484750:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596032 00000100:00100000:0.0:1789427861.484754:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 360 00000100:00100000:3.0:1789427861.484755:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596032 00000100:00100000:0.0:1789427861.484768:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931595776:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427861.484774:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596416 00000100:00100000:3.0:1789427861.484778:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596416 00000100:00100000:3.0:1789427861.484793:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596288 00000100:00100000:3.0:1789427861.484795:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596288 00000100:00100000:3.0:1789427861.484812:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:3.0:1789427861.484822:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931595904:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427861.484839:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931595776:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.484848:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 360 00000100:00100000:3.0:1789427861.484856:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931595904:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427861.484862:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:3.0:1789427861.484876:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:3.0:1789427861.484883:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596032:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427861.484892:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 198 00000100:00100000:0.0:1789427861.484904:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931596416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427861.484913:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596032:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427861.484920:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:0.0:1789427861.484937:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931596416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427861.484939:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:3.0:1789427861.484966:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931596288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427861.484994:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931596288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.488437:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 198 00000100:00100000:3.0:1789427861.489409:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:3.0:1789427861.489450:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596160 00000100:00100000:3.0:1789427861.489460:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596160 00000100:00100000:3.0:1789427861.489580:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1789427861.489590:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931596160:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427861.489739:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931596160:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 150us (5115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427861.489747:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00080000:3.0:1789427861.489767:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427861.489772:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427861.489775:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427861.809586:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427861.809624:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940059904:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.809695:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.809788:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940060032:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.809856:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.809898:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060032 00000100:00100000:0.0:1789427861.809905:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060032 00000100:00100000:0.0:1789427861.809950:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789427861.809960:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940060032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810011:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940060032:12345-0@lo:400:kworker.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.810018:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789427861.810061:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940060032:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810097:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940060160:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810125:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810167:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940060288:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810190:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810215:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060288 00000100:00100000:0.0:1789427861.810219:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060288 00000100:00100000:0.0:1789427861.810241:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789427861.810247:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940060288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810280:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940060288:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.810286:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789427861.810323:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940060288:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810349:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427861.810363:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940060416:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810386:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810445:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940060544:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810467:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810507:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940060672:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810528:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810549:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060544 00000100:00100000:0.0:1789427861.810552:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060544 00000100:00100000:0.0:1789427861.810577:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060672 00000100:00100000:0.0:1789427861.810580:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060672 00000100:00100000:0.0:1789427861.810600:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789427861.810606:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940060544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810634:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940060544:12345-0@lo:400:kworker.0 Request processed in 29us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.810640:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789427861.810651:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789427861.810656:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940060672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810684:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940060672:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.810690:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:0.0:1789427861.810716:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820000 x1876350940060672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427861.810727:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940060672:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810746:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940060544:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810772:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940060800:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810804:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.810847:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060800 00000100:00100000:0.0:1789427861.810851:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060800 00000100:00100000:0.0:1789427861.810876:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789427861.810883:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940060800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.810916:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940060800:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.810922:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789427861.811087:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940060800:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811116:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427861.811122:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940060928:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811145:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.811169:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060928 00000100:00100000:0.0:1789427861.811173:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060928 00000100:00100000:0.0:1789427861.811197:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789427861.811204:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940060928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811237:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940060928:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.811242:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789427861.811264:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940060928:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811306:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940061056:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811327:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.811353:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061056 00000100:00100000:0.0:1789427861.811356:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061056 00000100:00100000:0.0:1789427861.811378:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789427861.811384:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940061056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811441:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940061056:12345-0@lo:400:kworker.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.811447:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789427861.811473:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940061056:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811504:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940061184:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811524:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.811547:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061184 00000100:00100000:0.0:1789427861.811551:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061184 00000100:00100000:0.0:1789427861.811575:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789427861.811581:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940061184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811612:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940061184:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.811619:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:0.0:1789427861.811641:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820000 x1876350940061184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427861.811651:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940061184:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811685:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940061312:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811707:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.811728:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061312 00000100:00100000:0.0:1789427861.811732:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061312 00000100:00100000:0.0:1789427861.811753:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789427861.811760:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940061312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811792:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940061312:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.811798:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789427861.811831:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820000 x1876350940061312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427861.811840:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940061312:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811868:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427861.811874:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940061440:0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811896:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.811916:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061440 00000100:00100000:0.0:1789427861.811919:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061440 00000100:00100000:0.0:1789427861.811940:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789427861.811946:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940061440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427861.811978:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940061440:12345-0@lo:400:kworker.0 Request processed in 32us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.811984:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789427861.812006:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820000 x1876350940061440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427861.812015:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940061440:0@lo:400:kworker.0 00000100:00100000:1.0:1789427861.812154:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427861.812163:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940061568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427861.812190:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427861.812216:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061568 00000100:00100000:1.0:1789427861.812220:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061568 00000100:00100000:1.0:1789427861.812245:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789427861.812259:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940061568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427861.812280:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427861.812325:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940061568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427861.812331:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1789427861.812357:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4e00 x1876350940061568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427861.812370:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940061568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427861.812458:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940059904 00000100:00100000:2.0:1789427861.812463:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940059904 00000100:00100000:2.0:1789427861.812500:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789427861.812509:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940059904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427861.812546:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940059904:12345-0@lo:400:kworker.0 Request processed in 39us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427861.812559:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789427861.812585:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060160 00000100:00100000:2.0:1789427861.812589:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060160 00000100:00100000:2.0:1789427861.812610:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940060416 00000100:00100000:2.0:1789427861.812613:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940060416 00000100:00100000:2.0:1789427861.812625:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789427861.812631:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940060160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427861.812664:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940060160:12345-0@lo:400:kworker.0 Request processed in 33us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427861.812669:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789427861.812680:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427861.812685:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940060416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427861.812711:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940060416:12345-0@lo:400:kworker.0 Request processed in 26us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427861.812716:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427861.812745:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940060416:0@lo:400:kworker.0 00000100:00100000:2.0:1789427861.812754:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940059904:0@lo:400:kworker.0 00000100:00100000:1.0:1789427861.812831:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940060160:0@lo:400:kworker.0 00000100:00080000:3.0:1789427861.812946:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427861.812951:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427861.812954:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427861.812956:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427861.813008:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940061696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427861.813032:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427861.813099:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061696 00000100:00100000:3.0:1789427861.813103:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061696 00000100:00100000:3.0:1789427861.813132:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789427861.813139:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940061696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427861.813149:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427861.813188:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940061696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427861.813194:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1789427861.813287:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e26d80 x1876350940061696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427861.813312:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940061696:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789427861.936783:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427862.833928:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427862.833951:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940061824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427862.834018:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427862.834184:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061824 00000100:00100000:1.0:1789427862.834193:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061824 00000100:00100000:1.0:1789427862.834246:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789427862.834256:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940061824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427862.834319:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427862.834374:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940061824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427862.834381:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427862.834511:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940061824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427862.834734:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940061952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427862.834767:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427862.834908:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940061952 00000100:00100000:2.0:1789427862.834914:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940061952 00000100:00100000:2.0:1789427862.834951:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789427862.834959:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940061952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427862.834988:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427862.835030:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940061952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427862.835036:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789427862.835148:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940061952:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789427862.897275:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789427862.963074:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427862.963663:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427863.856723:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427863.856811:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427863.856980:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062080 00000100:00100000:3.0:1789427863.856989:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062080 00000100:00100000:3.0:1789427863.857039:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789427863.857047:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940062080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427863.857087:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427863.857138:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940062080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.857159:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789427863.857310:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940062080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427863.984671:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427865.008644:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427866.032622:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427866.416618:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940062208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427866.416674:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427866.416743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062208 00000100:00100000:3.0:1789427866.416752:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062208 00000100:00100000:3.0:1789427866.416807:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789427866.416818:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940062208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427866.416855:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427866.416909:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940062208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427866.416917:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789427866.416945:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940062208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427866.595005:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427866.595071:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427866.595088:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596544 00000100:00100000:2.0:1789427866.595105:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596544 00000100:00100000:0.0:1789427866.595112:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427866.595143:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596800 00000100:00100000:1.0:1789427866.595149:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596800 00000100:00100000:3.0:1789427866.595169:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596672 00000100:00100000:2.0:1789427866.595175:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 362 00000100:00100000:3.0:1789427866.595177:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596672 00000100:00100000:2.0:1789427866.595189:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931596544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427866.595209:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:1.0:1789427866.595219:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:0.0:1789427866.595225:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596800:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427866.595235:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596672:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:3.0:1789427866.595238:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427866.595243:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427866.595274:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931596544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427866.595282:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596800:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.595288:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 362 00000100:00100000:1.0:1789427866.595295:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931596672:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427866.595300:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:1.0:1789427866.595309:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:0.0:1789427866.598122:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427866.598161:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427866.598196:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597056 00000100:00100000:3.0:1789427866.598206:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597056 00000100:00100000:0.0:1789427866.598210:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00080000:0.0:1789427866.598276:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427866.598282:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931596928 00000100:00100000:2.0:1789427866.598288:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931596928 00000100:00100000:3.0:1789427866.598292:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597184 00000100:00100000:3.0:1789427866.598298:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597184 00000100:00100000:0.0:1789427866.598304:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 208 00000100:00100000:0.0:1789427866.598319:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597056:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427866.598341:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:2.0:1789427866.598342:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:3.0:1789427866.598358:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427866.598359:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931596928:12345-192.168.202.24@tcp:9:kworker.0 00000100:00100000:0.0:1789427866.598383:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597056:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000020:00000080:2.0:1789427866.598385:0:8401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51851c 00000100:00100000:0.0:1789427866.598396:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 208 00000100:00080000:2.0:1789427866.598397:0:8401:0:(import.c:65:import_set_state_nolock()) ffff919583caa800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789427866.598405:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427866.598444:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00080000:0.0:1789427866.598457:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427866.598461:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1789427866.598479:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1789427866.598606:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427866.598629:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+2:2393:x1876350931596928:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 276us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.598636:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1789427866.928632:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940062336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427866.928634:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940062464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427866.928640:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940062720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.928701:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940062592:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.928716:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427866.928720:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427866.928742:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427866.928763:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062720 00000100:00100000:2.0:1789427866.928776:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062720 00000100:00100000:3.0:1789427866.928781:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940063104:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.928791:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940063232:0@lo:400:kworker.0 00000100:00100000:0.0:1789427866.928791:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940062848:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.928804:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427866.928831:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789427866.928839:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427866.928841:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427866.928845:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940063616:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.928857:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940062720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427866.928872:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940063360:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.928879:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427866.928884:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940063744:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.928907:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940064128:0@lo:400:kworker.0 00000100:00100000:0.0:1789427866.928918:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427866.928934:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062592 00000100:00100000:2.0:1789427866.928939:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940062720:12345-0@lo:400:kworker.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427866.928940:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062592 00000100:00100000:3.0:1789427866.928949:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427866.928951:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940063872:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.928954:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789427866.928978:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063232 00000100:00100000:1.0:1789427866.928983:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789427866.928985:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063232 00000100:00100000:3.0:1789427866.928989:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063104 00000100:00100000:0.0:1789427866.928992:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427866.928993:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940062592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.928994:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063104 00000100:00100000:0.0:1789427866.929021:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789427866.929026:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062848 00000100:00100000:2.0:1789427866.929029:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063360 00000100:00100000:3.0:1789427866.929030:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062848 00000100:00100000:0.0:1789427866.929030:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940062976:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929037:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063360 00000100:00100000:1.0:1789427866.929051:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940062592:12345-0@lo:400:kworker.0 Request processed in 58us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427866.929055:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427866.929062:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427866.929066:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789427866.929069:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940063104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929069:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063872 00000100:00100000:2.0:1789427866.929076:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063872 00000100:00100000:0.0:1789427866.929076:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940063488:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.929105:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062976 00000100:00100000:1.0:1789427866.929111:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062976 00000100:00100000:2.0:1789427866.929115:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789427866.929115:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427866.929122:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940063104:12345-0@lo:400:kworker.0 Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929132:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940063232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929133:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427866.929139:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940064000:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.929143:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789427866.929155:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940063360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929160:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789427866.929171:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940062848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427866.929178:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427866.929185:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940063232:12345-0@lo:400:kworker.0 Request processed in 58us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929195:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789427866.929207:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940063360:12345-0@lo:400:kworker.0 Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929217:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00010000:00080000:0.0:1789427866.929221:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e27100 x1876350940063360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427866.929226:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940062848:12345-0@lo:400:kworker.0 Request processed in 57us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427866.929229:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789427866.929232:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940063872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929255:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789427866.929268:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940063360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.929271:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789427866.929281:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063616 00000100:00100000:3.0:1789427866.929286:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063616 00000100:00100000:1.0:1789427866.929286:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940062976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929295:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940063872:12345-0@lo:400:kworker.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929304:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00080000:0.0:1789427866.929305:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e25880 x1876350940063872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427866.929306:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064128 00000100:00100000:3.0:1789427866.929310:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064128 00000100:00100000:0.0:1789427866.929320:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940063872:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929330:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063488 00000100:00080000:2.0:1789427866.929331:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427866.929333:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063488 00000100:00080000:2.0:1789427866.929338:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427866.929338:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940062976:12345-0@lo:400:kworker.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00080000:2.0:1789427866.929345:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427866.929350:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427866.929350:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789427866.929351:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064000 00000100:00100000:0.0:1789427866.929352:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940062976:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929356:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064000 00000100:00100000:2.0:1789427866.929371:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789427866.929373:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940062848:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929392:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940063616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929400:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789427866.929405:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062336 00000100:00100000:1.0:1789427866.929411:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062336 00000100:00100000:3.0:1789427866.929440:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427866.929441:0:8902:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789427866.929452:0:8902:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789427866.929463:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940063616:12345-0@lo:400:kworker.0 Request processed in 74us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427866.929464:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789427866.929475:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789427866.929477:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940062336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427866.929482:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427866.929498:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00002000:00000024:1.0:1789427866.929506:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427866.929507:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940063488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929567:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940064128:12345-0@lo:400:kworker.0 Request processed in 157us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427866.929571:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940062720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929579:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789427866.929590:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940062336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929594:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940063488:12345-0@lo:400:kworker.0 Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427866.929596:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940063232:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929600:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789427866.929606:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789427866.929615:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940064000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929615:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789427866.929635:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940063488:0@lo:400:kworker.0 00010000:00080000:0.0:1789427866.929649:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df7b80 x1876350940062336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427866.929651:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940063744 00000100:00100000:3.0:1789427866.929653:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940064000:12345-0@lo:400:kworker.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929657:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940063744 00000100:00100000:3.0:1789427866.929666:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789427866.929683:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940062336:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789427866.929693:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427866.929698:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00080000:3.0:1789427866.929701:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427866.929710:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940063744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.929711:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789427866.929716:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e25c00 x1876350940064000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427866.929728:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940064000:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929734:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940062592:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929749:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940063104:0@lo:400:kworker.0 00000100:00100000:3.0:1789427866.929761:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940063616:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929766:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940063744:12345-0@lo:400:kworker.0 Request processed in 59us (287us total) trans 0 rc 0/0 00010000:00080000:3.0:1789427866.929773:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e25180 x1876350940064128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427866.929777:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789427866.929787:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940064128:0@lo:400:kworker.0 00000100:00100000:1.0:1789427866.929808:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940063744:0@lo:400:kworker.0 00000100:00100000:2.0:1789427866.929821:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940062464 00000100:00100000:2.0:1789427866.929826:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940062464 00000100:00100000:2.0:1789427866.929864:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789427866.929872:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940062464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427866.929882:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427866.929916:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940062464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427866.929923:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789427866.929949:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e26680 x1876350940062464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427866.929963:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940062464:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789427867.056608:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427867.952690:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940064256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427867.952743:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427867.952887:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427867.952896:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940064384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427867.952925:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427867.952954:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064256 00000100:00100000:1.0:1789427867.952961:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064256 00000100:00100000:1.0:1789427867.953000:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064384 00000100:00100000:1.0:1789427867.953014:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064384 00000100:00100000:1.0:1789427867.953032:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789427867.953040:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940064256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427867.953066:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427867.953107:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940064256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427867.953114:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789427867.953132:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789427867.953138:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940064384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427867.953148:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427867.953177:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940064384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427867.953183:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789427867.953226:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940064384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427867.953328:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940064256:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427868.080639:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427868.977676:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940064512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427868.977747:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427868.978093:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064512 00000100:00100000:3.0:1789427868.978101:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064512 00000100:00100000:3.0:1789427868.978270:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789427868.978280:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940064512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427868.978313:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427868.978406:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940064512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427868.978433:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789427868.978692:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940064512:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789427869.107701:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427870.129255:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427871.152635:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427871.536583:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940064640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427871.536644:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427871.536744:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064640 00000100:00100000:2.0:1789427871.536762:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064640 00000100:00100000:2.0:1789427871.536810:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789427871.536818:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940064640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427871.536847:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427871.536891:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940064640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427871.536897:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789427871.536934:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940064640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427871.715634:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427871.715679:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427871.715765:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597440 00000100:00100000:1.0:1789427871.715776:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597440 00000100:00100000:1.0:1789427871.715845:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:1.0:1789427871.715855:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931597440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427871.715920:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931597440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427871.715927:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:2.0:1789427871.716121:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597312 00000100:00100000:2.0:1789427871.716125:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597312 00000100:00100000:2.0:1789427871.716168:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 364 00000100:00100000:2.0:1789427871.716176:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931597312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427871.716247:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931597312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 71us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427871.716253:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 364 00000100:00080000:3.0:1789427871.716273:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427871.717462:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427871.717489:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427871.717514:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427871.717570:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597568 00000100:00100000:3.0:1789427871.717575:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597568 00000100:00100000:3.0:1789427871.717615:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597696 00000100:00100000:3.0:1789427871.717617:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597696 00000100:00100000:3.0:1789427871.717634:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597824 00000100:00100000:3.0:1789427871.717636:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597824 00000100:00100000:3.0:1789427871.717649:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:3.0:1789427871.717655:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931597568:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427871.717692:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931597568:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427871.717698:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:3.0:1789427871.717711:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:3.0:1789427871.717716:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597696:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427871.717734:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597696:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 18us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427871.717739:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:3.0:1789427871.717749:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:3.0:1789427871.717754:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427871.717771:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931597824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 17us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427871.717776:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00080000:0.0:1789427871.718047:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427871.718051:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427872.049565:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940064896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427872.049592:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940064768:0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.049642:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940065152:0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.050853:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.050853:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.050901:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.050901:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940065280:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.050929:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.050931:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940065408:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.050946:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940065792:0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.050951:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.050966:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940065920:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.050974:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.050982:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.050990:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940066304:0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.050995:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789427872.051000:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940065024:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051006:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.051018:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.051031:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940065536:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051038:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064768 00000100:00100000:0.0:1789427872.051044:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064768 00000100:00100000:3.0:1789427872.051049:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427872.051064:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940066048:0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.051083:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.051083:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789427872.051090:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.051125:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940064896 00000100:00100000:3.0:1789427872.051128:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940064896 00000100:00100000:0.0:1789427872.051135:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940064768:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051142:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789427872.051171:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065280 00000100:00100000:0.0:1789427872.051175:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065280 00000100:00100000:0.0:1789427872.051191:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065408 00000100:00100000:0.0:1789427872.051194:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065408 00000100:00100000:0.0:1789427872.051222:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065920 00000100:00100000:0.0:1789427872.051225:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065920 00000100:00100000:0.0:1789427872.051237:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065024 00000100:00100000:0.0:1789427872.051240:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065024 00000100:00100000:2.0:1789427872.051249:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940065664:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051249:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065536 00000100:00100000:0.0:1789427872.051251:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065536 00000100:00100000:0.0:1789427872.051261:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066048 00000100:00100000:0.0:1789427872.051263:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066048 00000100:00100000:2.0:1789427872.051275:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.051275:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789427872.051281:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940065280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051292:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940066176:0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051310:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.051311:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940065280:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051316:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789427872.051329:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789427872.051333:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427872.051335:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051339:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940066432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427872.051362:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427872.051365:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940065408:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051372:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789427872.051384:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789427872.051390:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940065920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051398:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065152 00000100:00100000:2.0:1789427872.051406:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065152 00000100:00100000:0.0:1789427872.051439:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940065920:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051444:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789427872.051447:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789427872.051453:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940065152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051455:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789427872.051459:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940065024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051482:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940065024:12345-0@lo:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427872.051486:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940065152:12345-0@lo:400:kworker.0 Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051488:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789427872.051492:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789427872.051498:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789427872.051504:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940065536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051506:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065792 00000100:00100000:2.0:1789427872.051509:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065792 00000100:00100000:2.0:1789427872.051530:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066304 00000100:00100000:0.0:1789427872.051531:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940065536:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427872.051532:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066304 00000100:00100000:0.0:1789427872.051536:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789427872.051542:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940065664 00000100:00100000:2.0:1789427872.051544:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940065664 00000100:00100000:0.0:1789427872.051546:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789427872.051551:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940066048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051554:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066176 00000100:00100000:2.0:1789427872.051556:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066176 00000100:00100000:2.0:1789427872.051567:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789427872.051573:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940065792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051573:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940066048:12345-0@lo:400:kworker.0 Request processed in 22us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051579:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789427872.051596:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427872.051599:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940065792:12345-0@lo:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051602:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940066304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.051604:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789427872.051614:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789427872.051618:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940065664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051634:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940066304:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427872.051637:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940065664:12345-0@lo:400:kworker.0 Request processed in 19us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427872.051640:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427872.051643:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789427872.051651:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789427872.051656:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940066176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.051683:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940066176:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427872.051692:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427872.051700:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940064896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427872.051725:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427872.051756:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940064896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427872.051761:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427872.051773:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066432 00000100:00100000:3.0:1789427872.051776:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066432 00000100:00100000:3.0:1789427872.051790:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789427872.051796:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350940066432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427872.051804:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427872.051839:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350940066432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427872.051844:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789427872.051894:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940065024:0@lo:400:kworker.0 00010000:00080000:3.0:1789427872.051907:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e27800 x1876350940065536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427872.051917:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940065536:0@lo:400:kworker.0 00010000:00080000:3.0:1789427872.051924:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e24700 x1876350940066048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427872.051932:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940066048:0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.051939:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940065408:0@lo:400:kworker.0 00000100:00100000:3.0:1789427872.051946:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940065920:0@lo:400:kworker.0 00010000:00080000:3.0:1789427872.051953:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539500 x1876350940064896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427872.051965:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940064896:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789427872.052050:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4a80 x1876350940066432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427872.052061:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940066432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427872.052090:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940065152:0@lo:400:kworker.0 00000100:00100000:2.0:1789427872.052098:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940065664:0@lo:400:kworker.0 00010000:00080000:2.0:1789427872.052105:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e25880 x1876350940066176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427872.052113:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940066176:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.052309:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789427872.052327:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427872.052331:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427872.052333:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427872.052336:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427872.052354:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940064768:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.052364:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940065280:0@lo:400:kworker.0 00000100:00100000:0.0:1789427872.052372:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940065792:0@lo:400:kworker.0 00010000:00080000:0.0:1789427872.052380:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583e27100 x1876350940066304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427872.052388:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940066304:0@lo:400:kworker.0 00000040:00080000:0.0:1789427872.112859:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789427872.177127:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427872.179185:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427872.563767:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:3.0:1789427872.563779:0:8395:0:(genops.c:885:class_export_put()) final put ffff919583cab800/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:1.0:1789427872.563863:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919583cab800/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-OST0000 00000020:00000080:1.0:1789427872.564001:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583caa800 for lustre-OST0000 00000100:00100000:2.0:1789427873.076799:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427873.076820:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940066560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427873.076888:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427873.076961:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066560 00000100:00100000:2.0:1789427873.076969:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066560 00000100:00100000:2.0:1789427873.077014:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427873.077023:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940066560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427873.077052:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427873.077095:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940066560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427873.077102:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427873.077148:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940066560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427873.086177:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940066688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427873.086261:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427873.086400:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066688 00000100:00100000:3.0:1789427873.086408:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066688 00000100:00100000:3.0:1789427873.086478:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789427873.086486:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940066688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427873.086505:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427873.089389:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940066688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2894us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427873.089446:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789427873.091785:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940066688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427873.206704:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427874.096638:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427874.096717:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940066816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427874.096799:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427874.096861:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066816 00000100:00100000:1.0:1789427874.096870:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066816 00000100:00100000:1.0:1789427874.096922:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789427874.096933:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940066816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427874.096965:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789427874.097019:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940066816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427874.097026:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789427874.097147:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940066816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427874.227981:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427875.248617:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427876.272687:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427876.658209:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940066944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427876.658328:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427876.658454:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940066944 00000100:00100000:2.0:1789427876.658463:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940066944 00000100:00100000:2.0:1789427876.658505:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427876.658515:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940066944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427876.658562:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427876.658626:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940066944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427876.658634:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789427876.658701:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940066944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427876.835455:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427876.835497:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427876.835623:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598080 00000100:00100000:3.0:1789427876.835633:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598080 00000100:00100000:3.0:1789427876.835717:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:3.0:1789427876.835728:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931598080:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427876.835810:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931598080:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427876.835817:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:0.0:1789427876.835993:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00080000:2.0:1789427876.836069:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427876.836115:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598336 00000100:00100000:3.0:1789427876.836120:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598336 00000100:00100000:3.0:1789427876.836170:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00100000:3.0:1789427876.836178:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931598336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427876.836211:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931598336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427876.836217:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00080000:2.0:1789427876.836324:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427876.836700:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931597952 00000100:00100000:1.0:1789427876.836705:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931597952 00000100:00100000:1.0:1789427876.836757:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 366 00000100:00100000:1.0:1789427876.836767:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931597952:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427876.836808:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931597952:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427876.836815:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 366 00000100:00100000:0.0:1789427876.837543:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427876.837577:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427876.837660:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598208 00000100:00100000:2.0:1789427876.837666:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598208 00000100:00100000:2.0:1789427876.837708:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598464 00000100:00100000:2.0:1789427876.837711:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598464 00000100:00100000:2.0:1789427876.837740:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:2.0:1789427876.837757:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931598208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427876.837796:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931598208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427876.837803:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:2.0:1789427876.837816:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00100000:2.0:1789427876.837823:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931598464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427876.837845:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931598464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427876.837851:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00080000:0.0:1789427876.838034:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427877.168622:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940067328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427877.168631:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940067200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427877.168685:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940067456:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.168703:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427877.168706:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940067584:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.168727:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427877.168756:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427877.168770:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067328 00000100:00100000:2.0:1789427877.168779:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067328 00000100:00100000:0.0:1789427877.168780:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940067072:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.168783:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940067968:0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.168786:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940068096:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.168822:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427877.168832:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427877.168837:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427877.168839:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427877.168852:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940067328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427877.168865:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940068480:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.168869:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940067840:0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.168886:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940068608:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.168905:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789427877.168922:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427877.168924:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067456 00000100:00100000:0.0:1789427877.168929:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067456 00000100:00100000:3.0:1789427877.168930:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427877.168966:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067968 00000100:00100000:0.0:1789427877.168967:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068480 00000100:00100000:3.0:1789427877.168969:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789427877.168970:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068480 00000100:00100000:2.0:1789427877.168978:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940067328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427877.168981:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940068224:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.168981:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067968 00000100:00100000:2.0:1789427877.168993:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789427877.168993:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789427877.169001:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940067456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169029:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789427877.169030:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427877.169031:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068096 00000100:00100000:2.0:1789427877.169036:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068096 00000100:00100000:1.0:1789427877.169049:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169064:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068608 00000100:00100000:3.0:1789427877.169065:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940068736:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.169065:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940067456:12345-0@lo:400:kworker.0 Request processed in 62us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427877.169068:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068608 00000100:00100000:0.0:1789427877.169080:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789427877.169093:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068224 00000100:00100000:2.0:1789427877.169096:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068224 00000100:00100000:0.0:1789427877.169103:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789427877.169113:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940068480:12345-0@lo:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427877.169120:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789427877.169122:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427877.169123:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940067968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169133:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789427877.169134:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940068096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169175:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067584 00000100:00100000:3.0:1789427877.169181:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067584 00000100:00100000:2.0:1789427877.169196:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940068096:12345-0@lo:400:kworker.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427877.169204:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067072 00000100:00100000:2.0:1789427877.169206:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789427877.169210:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067072 00000100:00100000:0.0:1789427877.169216:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940067968:12345-0@lo:400:kworker.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427877.169228:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789427877.169229:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789427877.169236:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068736 00000100:00100000:2.0:1789427877.169242:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068736 00000100:00100000:3.0:1789427877.169243:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940067584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169249:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789427877.169261:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940067072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.169267:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427877.169280:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789427877.169280:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169292:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940067584:12345-0@lo:400:kworker.0 Request processed in 54us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427877.169296:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940068224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169306:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789427877.169311:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940067072:12345-0@lo:400:kworker.0 Request processed in 51us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427877.169321:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789427877.169332:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940068608:12345-0@lo:400:kworker.0 Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427877.169340:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427877.169347:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940068224:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427877.169351:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789427877.169357:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427877.169362:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789427877.169363:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940068736:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789427877.169364:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427877.169371:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427877.169397:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940067456:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169398:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427877.169404:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940068736:12345-0@lo:400:kworker.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427877.169411:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789427877.169445:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf985500 x1876350940067968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427877.169458:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427877.169462:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940067968:0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169464:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940068224:0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169470:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940068352:0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169487:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940067712:0@lo:400:kworker.0 00010000:00080000:0.0:1789427877.169491:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf985c00 x1876350940068480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789427877.169493:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf984e00 x1876350940068736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427877.169510:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427877.169518:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940068480:0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169522:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067840 00000100:00100000:3.0:1789427877.169523:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940068736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169526:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067840 00000100:00100000:3.0:1789427877.169546:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940067584:0@lo:400:kworker.0 00010000:00080000:1.0:1789427877.169560:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583539180 x1876350940067328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427877.169561:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068352 00000100:00100000:2.0:1789427877.169565:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068352 00000100:00100000:3.0:1789427877.169569:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940068096:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.169572:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789427877.169587:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940067328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427877.169587:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169594:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00010000:00080000:3.0:1789427877.169599:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf987480 x1876350940068608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427877.169608:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940068352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427877.169613:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940067072:0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169618:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940068608:0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.169642:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940067840:12345-0@lo:400:kworker.0 Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427877.169651:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789427877.169656:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940067840:0@lo:400:kworker.0 00000100:00100000:2.0:1789427877.169663:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940068352:12345-0@lo:400:kworker.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427877.169671:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067200 00000100:00100000:1.0:1789427877.169675:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940068352:0@lo:400:kworker.0 00000100:00100000:3.0:1789427877.169679:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067200 00000100:00080000:0.0:1789427877.169688:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427877.169691:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789427877.169715:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789427877.169723:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940067200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427877.169731:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789427877.169735:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427877.169764:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940067200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427877.169769:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1789427877.169776:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6d80 x1876350940067200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427877.169792:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940067200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427877.169797:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940067712 00000100:00100000:0.0:1789427877.169802:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940067712 00000100:00100000:0.0:1789427877.169832:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789427877.169840:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940067712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427877.169880:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940067712:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427877.169895:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789427877.169930:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940067712:0@lo:400:kworker.0 00010000:00010000:2.0:1789427877.296587:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427878.192624:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940068864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427878.192654:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940068992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427878.192692:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427878.192758:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068864 00000100:00100000:2.0:1789427878.192765:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068864 00000100:00100000:2.0:1789427878.192820:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789427878.192832:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940068864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427878.192859:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427878.192908:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940068864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427878.192914:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789427878.193020:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958353aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940068864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427878.193053:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427878.193261:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940068992 00000100:00100000:0.0:1789427878.193272:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940068992 00000100:00100000:0.0:1789427878.193313:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789427878.193319:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940068992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427878.193329:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427878.193410:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940068992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427878.193439:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789427878.193486:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940068992:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789427878.320889:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427879.216671:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940069120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427879.216767:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427879.216834:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069120 00000100:00100000:2.0:1789427879.216847:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069120 00000100:00100000:2.0:1789427879.216908:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789427879.216916:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940069120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427879.216953:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427879.217059:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940069120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427879.217064:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789427879.217164:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940069120:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427879.348816:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427880.368662:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427881.392562:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427881.776771:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940069248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427881.776865:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427881.777196:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069248 00000100:00100000:3.0:1789427881.777205:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069248 00000100:00100000:3.0:1789427881.777257:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789427881.777267:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940069248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427881.777296:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427881.789603:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940069248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12329us (12730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427881.789617:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789427881.791467:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940069248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427881.959515:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427881.959618:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427881.959649:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427881.959687:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427881.959715:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427881.959743:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598848 00000100:00100000:2.0:1789427881.959751:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598848 00000100:00100000:2.0:1789427881.959796:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599104 00000100:00100000:2.0:1789427881.959799:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599104 00000100:00100000:2.0:1789427881.959810:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598720 00000100:00100000:2.0:1789427881.959813:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598720 00000100:00100000:2.0:1789427881.959823:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598976 00000100:00100000:2.0:1789427881.959825:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598976 00000100:00100000:2.0:1789427881.959840:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:2.0:1789427881.959849:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931598848:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427881.959913:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931598848:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 65us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427881.959920:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:2.0:1789427881.959936:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:2.0:1789427881.959942:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931599104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427881.959965:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931599104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427881.959970:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:2.0:1789427881.959985:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00100000:2.0:1789427881.959991:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931598720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427881.960027:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931598720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427881.960033:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00100000:2.0:1789427881.960051:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00100000:2.0:1789427881.960057:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931598976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427881.960083:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931598976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427881.960088:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00100000:0.0:1789427881.960180:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931598592 00000100:00100000:0.0:1789427881.960185:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931598592 00000100:00100000:0.0:1789427881.960221:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 368 00000100:00100000:0.0:1789427881.960231:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931598592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427881.960261:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931598592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427881.960268:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 368 00000100:00080000:3.0:1789427881.960307:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427881.960318:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789427882.288658:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940069888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427882.288727:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940069632:0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.288748:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940069760:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.288762:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.288782:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427882.288803:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.288833:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940070144:0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.288837:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940070272:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.288842:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940070400:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.288888:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.288978:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.289008:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940070656:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.289022:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940070912:0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.289036:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.289066:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.289067:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069632 00000100:00100000:1.0:1789427882.289076:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069632 00000100:00100000:0.0:1789427882.289078:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940070784:0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.289123:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.289138:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940069376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427882.289189:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070144 00000100:00100000:1.0:1789427882.289194:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070144 00000100:00100000:0.0:1789427882.289223:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069760 00000100:00100000:2.0:1789427882.289227:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.289227:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070272 00000100:00100000:0.0:1789427882.289230:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069760 00000100:00100000:1.0:1789427882.289233:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070272 00000100:00100000:2.0:1789427882.289255:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940069504:0@lo:400:kworker.0 00000100:00100000:1.0:1789427882.289263:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070784 00000100:00100000:1.0:1789427882.289266:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070784 00000100:00100000:0.0:1789427882.289281:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789427882.289290:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427882.289297:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940069760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427882.289300:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789427882.289319:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940070016:0@lo:400:kworker.0 00000100:00100000:1.0:1789427882.289334:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940069632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.289349:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.289360:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940070528:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.289381:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.289398:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940071040:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.289502:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427882.289502:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940069632:12345-0@lo:400:kworker.0 Request processed in 190us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.289514:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789427882.289538:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070016 00000100:00100000:1.0:1789427882.289541:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070016 00000100:00100000:1.0:1789427882.289553:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789427882.289557:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940070144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427882.289600:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940070144:12345-0@lo:400:kworker.0 Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.289606:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789427882.289630:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789427882.289637:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940070272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427882.289721:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940070272:12345-0@lo:400:kworker.0 Request processed in 83us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.289728:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789427882.289747:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789427882.289754:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940069760:12345-0@lo:400:kworker.0 Request processed in 461us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.289761:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940070784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.289767:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789427882.289797:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069888 00000100:00100000:0.0:1789427882.289803:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789427882.289804:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069888 00000100:00100000:1.0:1789427882.289806:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940070784:12345-0@lo:400:kworker.0 Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.289819:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789427882.289819:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.289846:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069376 00000100:00080000:1.0:1789427882.289852:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427882.289858:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069376 00000100:00080000:1.0:1789427882.289860:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427882.289864:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427882.289887:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.289903:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427882.289921:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940069888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427882.289948:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427882.289963:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940070016:12345-0@lo:400:kworker.0 Request processed in 148us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427882.289971:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789427882.289989:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070656 00000100:00100000:1.0:1789427882.289994:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940069632:0@lo:400:kworker.0 00000100:00100000:0.0:1789427882.289995:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070656 00000100:00100000:2.0:1789427882.290004:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940069888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427882.290016:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940070144:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290021:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789427882.290032:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789427882.290042:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940070656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290047:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789427882.290057:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940069376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427882.290069:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427882.290078:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940069760:0@lo:400:kworker.0 00010000:00080000:1.0:1789427882.290092:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc81880 x1876350940070272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427882.290117:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940070272:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290122:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940069376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290130:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1789427882.290134:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca2b800 x1876350940070784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427882.290144:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940070784:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290154:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070400 00000100:00100000:2.0:1789427882.290159:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070400 00000100:00100000:2.0:1789427882.290201:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070912 00000100:00100000:2.0:1789427882.290204:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070912 00000100:00100000:2.0:1789427882.290213:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940070528 00000100:00100000:2.0:1789427882.290215:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940070528 00000100:00100000:2.0:1789427882.290227:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071040 00000100:00100000:2.0:1789427882.290229:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071040 00000100:00100000:2.0:1789427882.290240:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789427882.290246:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940070400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290277:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940070400:12345-0@lo:400:kworker.0 Request processed in 31us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290283:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789427882.290293:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789427882.290298:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940070912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290326:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940070912:12345-0@lo:400:kworker.0 Request processed in 28us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290332:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789427882.290341:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789427882.290346:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290366:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940070528:12345-0@lo:400:kworker.0 Request processed in 21us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290372:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789427882.290381:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789427882.290386:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940071040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290404:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940071040:12345-0@lo:400:kworker.0 Request processed in 18us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290410:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789427882.290764:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940070656:12345-0@lo:400:kworker.0 Request processed in 723us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427882.290771:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789427882.290848:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940069504 00000100:00100000:1.0:1789427882.290851:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940070656:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290854:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940069504 00000100:00100000:2.0:1789427882.290885:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789427882.290892:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940069504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.290924:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940069504:12345-0@lo:400:kworker.0 Request processed in 33us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.290930:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:2.0:1789427882.290972:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427882.290978:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427882.290980:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789427882.291027:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfa30e00 x1876350940069376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427882.291046:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940069376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427882.291064:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940069504:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.291140:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940070016:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.291155:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940070528:0@lo:400:kworker.0 00010000:00080000:2.0:1789427882.291165:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca28a80 x1876350940071040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427882.291175:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940071040:0@lo:400:kworker.0 00000100:00100000:2.0:1789427882.291222:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940070400:0@lo:400:kworker.0 00010000:00080000:2.0:1789427882.291232:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29f80 x1876350940070912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427882.291241:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940070912:0@lo:400:kworker.0 00010000:00080000:2.0:1789427882.291250:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9d5880 x1876350940069888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427882.291261:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940069888:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789427882.353188:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789427882.418338:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427882.418612:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427882.854565:0:14021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:18:01 (1789427881) 00000100:00100000:2.0:1789427883.312673:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427883.312696:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940071168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427883.312769:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427883.312841:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071168 00000100:00100000:2.0:1789427883.312848:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071168 00000100:00100000:2.0:1789427883.312896:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789427883.312905:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940071168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427883.312935:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427883.312994:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940071168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427883.313001:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789427883.313052:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940071168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427883.317472:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940071296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427883.317543:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.317700:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071296 00000100:00100000:0.0:1789427883.317720:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071296 00000100:00100000:0.0:1789427883.317781:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427883.317793:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940071296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427883.317823:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427883.317875:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940071296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.317885:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789427883.318003:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940071296:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789427883.443165:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427883.842109:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427883.842181:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599232 00000100:00100000:1.0:1789427883.842190:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599232 00000100:00100000:1.0:1789427883.842255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:1.0:1789427883.842264:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:11054:x1876350931599232:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427883.842281:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427883.842331:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede5185fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b22 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842386:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842400:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842435:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427883.842474:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789427883.842477:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427883.842504:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842530:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede5185fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b22 expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842558:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b22 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.842564:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e200) 00010000:00010000:1.0:1789427883.842566:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427883.842568:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47e00, rc 0) 00000100:00100000:1.0:1789427883.842615:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:11054:x1876350931599232:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 354us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427883.842620:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00080000:2.0:1789427883.842728:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427883.848530:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427883.848624:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599360 00000100:00100000:1.0:1789427883.848632:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599360 00000100:00100000:1.0:1789427883.848773:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:1.0:1789427883.848785:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:11055:x1876350931599360:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427883.848804:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427883.848823:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede51860a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b29 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848881:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848892:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848900:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848910:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848926:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848930:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848977:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848982:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.848986:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427883.849225:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789427883.849228:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427883.849254:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.849265:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.849271:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.849341:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.849348:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427883.849352:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850149:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850163:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e200) 00010000:00010000:1.0:1789427883.850165:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427883.850170:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850174:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850184:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850188:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850192:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850195:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427883.850197:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850200:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850204:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff919581d4e700) 00010000:00010000:1.0:1789427883.850205:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427883.850207:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850218:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518618 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850243:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede51860a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b29 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850251:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b29 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427883.850256:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919581d4e900) 00010000:00010000:1.0:1789427883.850258:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427883.850260:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46600, rc 0) 00000100:00100000:1.0:1789427883.850844:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:11055:x1876350931599360:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 2061us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427883.850850:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:3.0:1789427883.852810:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427883.852898:0:8903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599488 00000100:00100000:0.0:1789427883.852907:0:8903:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599488 00000100:00100000:0.0:1789427883.852992:0:8903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1789427883.853002:0:8903:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:2f916dfa-5c35-44f7-8247-070d65680205+7:11055:x1876350931599488:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789427883.853067:0:8903:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:2f916dfa-5c35-44f7-8247-070d65680205+7:11055:x1876350931599488:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.853075:0:8903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1789427883.855130:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427883.855246:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599744 00000100:00100000:2.0:1789427883.855255:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599744 00000100:00100000:2.0:1789427883.855302:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:2.0:1789427883.855309:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:11055:x1876350931599744:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427883.855330:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427883.855356:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518626 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b30 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855460:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855475:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855487:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855527:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855535:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855542:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855659:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51863b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855669:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51863b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855676:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51863b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427883.855686:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789427883.855769:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855775:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855779:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855784:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427883.855789:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855796:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855809:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919581d4e900) 00010000:00010000:2.0:1789427883.855812:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427883.855817:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855833:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51862d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855846:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855852:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855857:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855863:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427883.855866:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855872:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855880:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919581d49000) 00010000:00010000:2.0:1789427883.855882:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427883.855885:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.855889:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518634 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.856140:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518626 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b30 expref: 10 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.856160:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51863b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b30 expref: 9 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427883.856168:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427883.856170:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427883.856173:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429000, rc 0) 00000100:00100000:2.0:1789427883.856224:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+9:11055:x1876350931599744:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 916us (1425us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789427883.856230:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1789427883.862459:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427883.862530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931599872 00000100:00100000:2.0:1789427883.862540:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931599872 00000100:00100000:2.0:1789427883.862589:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:2.0:1789427883.862596:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:11055:x1876350931599872:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789427883.862780:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:11055:x1876350931599872:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 181us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427883.862788:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1789427883.868275:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427883.868330:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600000 00000100:00100000:1.0:1789427883.868340:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600000 00000100:00080000:2.0:1789427883.868394:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427883.868439:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1789427883.868464:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:11055:x1876350931600000:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789427883.869850:0:6482:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1343us 00000100:00100000:2.0:1789427883.883066:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:11055:x1876350931600000:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 14599us (14790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427883.883079:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:3.0:1789427884.337179:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940071424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427884.337250:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427884.338142:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071424 00000100:00100000:2.0:1789427884.338151:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071424 00000100:00100000:2.0:1789427884.338266:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789427884.338278:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940071424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427884.338326:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789427884.338395:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940071424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427884.338402:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789427884.338507:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940071424:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789427884.401126:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789427884.464898:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427884.465500:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789427885.489822:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427886.512953:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427886.897577:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427886.897606:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940071552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427886.897685:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427886.898222:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071552 00000100:00100000:2.0:1789427886.898231:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071552 00000100:00100000:2.0:1789427886.898281:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789427886.898291:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940071552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427886.898325:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427886.898376:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940071552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427886.898383:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789427886.898912:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940071552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427887.079610:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427887.079652:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427887.079681:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427887.079708:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427887.079729:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427887.079757:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600384 00000100:00100000:3.0:1789427887.079766:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600384 00000100:00100000:3.0:1789427887.079825:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600640 00000100:00100000:3.0:1789427887.079829:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600640 00000100:00100000:3.0:1789427887.079845:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600256 00000100:00100000:3.0:1789427887.079848:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600256 00000100:00100000:3.0:1789427887.079862:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600512 00000100:00100000:3.0:1789427887.079866:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600512 00000100:00100000:3.0:1789427887.079884:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 246 00000100:00100000:3.0:1789427887.079894:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931600384:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427887.079967:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931600384:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427887.079989:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 246 00000100:00100000:3.0:1789427887.080008:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:3.0:1789427887.080015:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931600640:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427887.080040:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931600640:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427887.080046:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:3.0:1789427887.080067:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:3.0:1789427887.080081:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+9:2394:x1876350931600256:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427887.080104:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+9:2394:x1876350931600256:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427887.080110:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:2.0:1789427887.080209:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600128 00000100:00100000:2.0:1789427887.080214:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600128 00000100:00100000:2.0:1789427887.080242:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 370 00000100:00100000:2.0:1789427887.080248:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931600128:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427887.080275:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931600128:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.080281:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 370 00000100:00100000:2.0:1789427887.080309:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 249 00000100:00100000:2.0:1789427887.080316:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931600512:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427887.080337:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931600512:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.080343:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 249 00000100:00080000:2.0:1789427887.080376:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427887.080385:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427887.409208:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940071680:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409285:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409345:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940072192:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409373:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409410:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940072704:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409454:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409477:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789427887.409483:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940072064:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409503:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409518:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940072576:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409540:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409554:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940073088:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409571:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427887.409600:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072192 00000100:00100000:0.0:1789427887.409607:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072192 00000100:00100000:0.0:1789427887.409652:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072704 00000100:00100000:0.0:1789427887.409655:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072704 00000100:00100000:0.0:1789427887.409671:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072064 00000100:00100000:0.0:1789427887.409673:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072064 00000100:00100000:0.0:1789427887.409687:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789427887.409695:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940072192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409741:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940072192:12345-0@lo:400:kworker.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427887.409747:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789427887.409778:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789427887.409784:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940072704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409808:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940072704:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427887.409814:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789427887.409824:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789427887.409830:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940072064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409861:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940072064:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427887.409867:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789427887.409906:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940072064:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409915:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940072192:0@lo:400:kworker.0 00000100:00100000:0.0:1789427887.409923:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940072704:0@lo:400:kworker.0 00000100:00100000:1.0:1789427887.410064:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071680 00000100:00100000:1.0:1789427887.410069:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071680 00000100:00100000:1.0:1789427887.410106:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789427887.410113:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940071680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427887.410156:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940071680:12345-0@lo:400:kworker.0 Request processed in 44us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427887.410163:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789427887.410201:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940071680:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410325:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940071808:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410354:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410373:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940072320:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410392:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410406:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940072832:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410439:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410454:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789427887.410460:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940071936:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410479:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410494:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940072448:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410511:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410525:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940072960:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410543:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427887.410565:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072576 00000100:00100000:2.0:1789427887.410569:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072576 00000100:00100000:2.0:1789427887.410593:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073088 00000100:00100000:2.0:1789427887.410596:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073088 00000100:00100000:2.0:1789427887.410608:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072448 00000100:00100000:2.0:1789427887.410610:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072448 00000100:00100000:2.0:1789427887.410619:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072960 00000100:00100000:2.0:1789427887.410621:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072960 00000100:00100000:2.0:1789427887.410632:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789427887.410638:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940072576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410669:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940072576:12345-0@lo:400:kworker.0 Request processed in 31us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.410675:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789427887.410692:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789427887.410697:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410724:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940073088:12345-0@lo:400:kworker.0 Request processed in 27us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.410729:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789427887.410738:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427887.410744:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940072448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410840:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940072448:12345-0@lo:400:kworker.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.410847:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427887.410858:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789427887.410865:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410890:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940072960:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.410896:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789427887.410938:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071936 00000100:00100000:2.0:1789427887.410942:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071936 00000100:00100000:2.0:1789427887.410963:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789427887.410969:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940071936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.410997:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940071936:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.411002:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789427887.411029:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940071808 00000100:00100000:2.0:1789427887.411032:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940071808 00000100:00100000:2.0:1789427887.411049:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072320 00000100:00100000:2.0:1789427887.411051:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072320 00000100:00100000:2.0:1789427887.411079:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940072832 00000100:00100000:2.0:1789427887.411088:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940072832 00000100:00100000:2.0:1789427887.411105:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789427887.411111:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940071808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.411140:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940071808:12345-0@lo:400:kworker.0 Request processed in 30us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.411146:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789427887.411158:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789427887.411164:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940072320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.411189:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940072320:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.411194:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789427887.411207:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789427887.411212:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.411237:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940072832:12345-0@lo:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427887.411243:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:2.0:1789427887.411260:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427887.411264:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427887.411266:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427887.411268:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427887.411286:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940071936:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.411294:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940072448:0@lo:400:kworker.0 00010000:00080000:2.0:1789427887.411304:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc81f80 x1876350940072960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427887.411313:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940072960:0@lo:400:kworker.0 00000100:00100000:2.0:1789427887.411332:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940071808:0@lo:400:kworker.0 00010000:00080000:2.0:1789427887.411340:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc80380 x1876350940072320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427887.411348:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940072320:0@lo:400:kworker.0 00010000:00080000:2.0:1789427887.411355:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc83100 x1876350940072832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427887.411362:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940072832:0@lo:400:kworker.0 00000100:00100000:1.0:1789427887.411484:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940073216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427887.411510:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427887.411537:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940072576:0@lo:400:kworker.0 00010000:00080000:1.0:1789427887.411546:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc83b80 x1876350940073088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427887.411553:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940073088:0@lo:400:kworker.0 00000100:00100000:1.0:1789427887.411574:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073216 00000100:00100000:1.0:1789427887.411577:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073216 00000100:00100000:1.0:1789427887.411601:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789427887.411606:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940073216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427887.411625:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427887.411654:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940073216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427887.411659:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1789427887.411682:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9d7100 x1876350940073216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427887.411693:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940073216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427887.411779:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427887.411789:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427887.411827:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427887.411968:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073344 00000100:00100000:1.0:1789427887.411972:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073344 00000100:00100000:1.0:1789427887.412001:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789427887.412014:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427887.412024:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427887.412073:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427887.412078:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789427887.413365:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bcc83100 x1876350940073344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427887.413384:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427887.538694:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427888.432623:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427888.432708:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427888.432852:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073472 00000100:00100000:1.0:1789427888.432861:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073472 00000100:00100000:1.0:1789427888.432918:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789427888.432928:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427888.432957:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427888.433014:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427888.433021:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789427888.433107:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427888.433268:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940073600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427888.433299:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427888.433402:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073600 00000100:00100000:1.0:1789427888.433407:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073600 00000100:00100000:1.0:1789427888.433469:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789427888.433476:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940073600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427888.433487:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427888.433560:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940073600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427888.433566:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789427888.433625:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940073600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789427888.561095:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427889.456666:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940073728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427889.456737:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427889.456946:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073728 00000100:00100000:3.0:1789427889.456954:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073728 00000100:00100000:3.0:1789427889.457904:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789427889.457916:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940073728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427889.457947:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789427889.458004:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940073728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427889.458011:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789427889.458092:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940073728:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1789427889.463962:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00010000:00010000:3.0:1789427889.584632:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427890.610881:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427891.633583:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427892.017837:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427892.017858:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427892.017916:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427892.018022:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073856 00000100:00100000:2.0:1789427892.018031:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073856 00000100:00100000:2.0:1789427892.018079:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789427892.018087:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427892.018118:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427892.018167:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940073856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.018174:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789427892.018247:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940073856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427892.136237:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.139650:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931600768 00000100:00100000:3.0:1789427892.139665:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931600768 00000100:00100000:3.0:1789427892.139738:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1789427892.139751:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:11098:x1876350931600768:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427892.139773:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427892.139795:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b37 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139857:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139872:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139883:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139907:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139915:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139921:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139969:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139977:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139984:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.139990:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.139994:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.140001:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.140023:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e200) 00010000:00010000:3.0:1789427892.140027:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.140032:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.140038:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.140058:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.140064:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789427892.141165:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427892.141222:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141228:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.141232:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141239:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141249:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9196a235fa00) 00010000:00010000:3.0:1789427892.141252:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.141255:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141261:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518657 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141300:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518649 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b37 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141309:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e200) 00010000:00010000:3.0:1789427892.141312:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.141323:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b37 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.141333:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a400, rc 0) 00000100:00100000:3.0:1789427892.141405:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:11098:x1876350931600768:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1656us (5176us total) trans 0 rc 301/301 00000100:00100000:3.0:1789427892.141431:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1789427892.147338:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.147376:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601024 00000100:00100000:3.0:1789427892.147386:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601024 00000100:00100000:3.0:1789427892.147452:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:3.0:1789427892.147461:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+8:11098:x1876350931601024:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:3.0:1789427892.147514:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427892.147539:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b22 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147556:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e200) 00010000:00010000:3.0:1789427892.147566:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427892.147620:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147634:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147644:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147654:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147678:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.147685:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148164:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148174:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148182:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427892.148196:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f4ab472b reply state 00000000669ed795 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148207:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148213:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427892.148216:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427892.148218:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789427892.148223:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789427892.148230:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148235:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148241:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148254:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.148258:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148264:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148271:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:3.0:1789427892.148273:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.148277:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148282:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51865e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427892.148296:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f4ab472b reply state 00000000669ed795 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148303:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.148308:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9196a235f000) 00010000:00010000:3.0:1789427892.148309:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427892.148311:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789427892.148399:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+9:11098:x1876350931601024:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 937us (1069us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789427892.148406:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789427892.209546:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.209586:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427892.209769:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601152 00000100:00100000:2.0:1789427892.209780:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601152 00000100:00100000:2.0:1789427892.209833:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 372 00000100:00100000:2.0:1789427892.209843:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931601152:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427892.209915:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2395:x1876350931601152:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.209954:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 372 00000100:00100000:3.0:1789427892.214335:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.218205:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427892.218322:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601280 00000100:00100000:1.0:1789427892.218331:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601280 00000100:00100000:0.0:1789427892.218610:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601536 00000100:00100000:0.0:1789427892.218615:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601536 00000100:00100000:0.0:1789427892.218643:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 256 00000100:00100000:0.0:1789427892.218661:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931601280:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427892.218730:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2395:x1876350931601280:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 79us (9142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.218738:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 256 00000100:00100000:0.0:1789427892.218754:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 257 00000100:00100000:0.0:1789427892.218761:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931601536:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427892.218782:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931601536:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 23us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.218788:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 257 00000100:00080000:1.0:1789427892.221618:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427892.224564:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601408 00000100:00100000:0.0:1789427892.224607:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601408 00000100:00100000:0.0:1789427892.224701:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 258 00000100:00100000:0.0:1789427892.224712:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931601408:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427892.224796:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931601408:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 86us (6602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.224804:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 258 00000100:00080000:1.0:1789427892.226215:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427892.337157:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.337693:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601664 00000100:00100000:3.0:1789427892.337717:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601664 00000100:00100000:3.0:1789427892.337787:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1789427892.337799:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+9:11106:x1876350931601664:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:3.0:1789427892.337822:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427892.337845:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b3e expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.337908:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.337922:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.337935:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427892.337989:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789427892.337993:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427892.338058:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.338092:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b3e expref: 11 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.338110:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b3e expref: 10 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.338118:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:3.0:1789427892.338120:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427892.338123:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b800, rc 0) 00000100:00100000:3.0:1789427892.338245:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+10:11106:x1876350931601664:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 447us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.338253:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:0.0:1789427892.462828:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.462975:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931601792 00000100:00100000:3.0:1789427892.462986:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931601792 00000100:00100000:3.0:1789427892.463079:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:3.0:1789427892.463089:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+10:11112:x1876350931601792:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427892.463108:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427892.463128:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b45 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463188:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463203:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463215:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463227:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463233:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463239:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463309:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463330:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463338:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427892.463372:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789427892.463375:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427892.463412:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463470:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463476:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463482:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463488:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.463491:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463498:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463508:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:3.0:1789427892.463510:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.463514:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463529:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede518688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463542:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463548:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463552:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463557:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.463560:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463565:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463572:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9196a235f000) 00010000:00010000:3.0:1789427892.463574:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.463577:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463583:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51868f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463603:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b45 expref: 12 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463627:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b45 expref: 11 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.463633:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427892.463636:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789427892.463638:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b000, rc 0) 00000100:00100000:3.0:1789427892.463702:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+11:11112:x1876350931601792:12345-192.168.202.24@tcp:101:bash.0 Request processed in 614us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.463709:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1789427892.490726:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.490880:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602048 00000100:00100000:3.0:1789427892.490891:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602048 00000100:00100000:3.0:1789427892.490960:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1789427892.490972:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+11:11112:x1876350931602048:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427892.490991:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427892.491022:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede51869d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b4c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491133:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491148:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491159:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491209:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491228:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491235:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427892.491590:0:6482:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789427892.491719:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491854:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491864:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491898:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491906:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491912:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491917:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427892.491921:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491927:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491949:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427892.491952:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.491957:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491963:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5186a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427892.491977:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000007dd13da reply state 00000000866c1097 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491987:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.491993:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:3.0:1789427892.491995:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427892.491997:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789427892.492035:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede51869d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.492049:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.492057:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:3.0:1789427892.492059:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427892.492115:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b400, rc 0) 00000100:00100000:3.0:1789427892.492176:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:11112:x1876350931602048:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1206us (1459us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789427892.492184:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:0.0:1789427892.508303:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.508380:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602176 00000100:00100000:3.0:1789427892.508390:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602176 00000100:00100000:3.0:1789427892.508458:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:3.0:1789427892.508465:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1876350931602176:12345-192.168.202.24@tcp:8:bash.0 00010000:00080000:3.0:1789427892.508501:0:8402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1789427892.508534:0:8402:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede5186c0 00002000:00100000:3.0:1789427892.508545:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f916dfa-5c35-44f7-8247-070d65680205/ffff919583caf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789427892.508561:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789427892.508657:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789427892.508683:0:8402:0:(import.c:65:import_set_state_nolock()) ffff919583cae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427892.508733:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931602176:12345-192.168.202.24@tcp:8:bash.0 Request processed in 267us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.508740:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:1.0:1789427892.519812:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427892.520037:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602304 00000100:00100000:2.0:1789427892.520047:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602304 00000100:00100000:2.0:1789427892.520133:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:2.0:1789427892.520144:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:0:x1876350931602304:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427892.520161:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427892.520184:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b53 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427892.520211:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789427892.520229:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=237s v=(0 0) 00010000:00010000:2.0:1789427892.520234:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427892.520242:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.520261:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.520274:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427892.520382:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:0:x1876350931602304:12345-192.168.202.24@tcp:101:bash.0 Request processed in 239us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.520389:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00080000:1.0:1789427892.520484:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427892.528838:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427892.528861:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940073984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427892.528928:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427892.529016:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940073984 00000100:00100000:1.0:1789427892.529024:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940073984 00000100:00100000:1.0:1789427892.529088:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789427892.529097:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940073984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427892.529117:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427892.529160:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940073984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427892.529166:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789427892.529190:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427892.529223:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940073984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427892.530274:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940074496:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.530310:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.530328:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940075008:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.530346:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.530357:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940075520:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.530373:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.530392:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789427892.530397:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940074368:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530571:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530604:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530625:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940074624:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530642:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530668:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940075136:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530684:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530697:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789427892.530701:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940074240:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530717:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530728:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940074752:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530742:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530752:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940075264:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530775:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427892.530797:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074624 00000100:00100000:3.0:1789427892.530802:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074624 00000100:00100000:3.0:1789427892.530828:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789427892.530835:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940074624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530873:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940074624:12345-0@lo:400:kworker.0 Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.530880:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789427892.530910:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940074624:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.530927:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074496 00000100:00100000:3.0:1789427892.530929:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074496 00000100:00100000:3.0:1789427892.530962:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074240 00000100:00100000:3.0:1789427892.530965:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074240 00000100:00100000:3.0:1789427892.530986:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074752 00000100:00100000:3.0:1789427892.530988:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074752 00000100:00100000:3.0:1789427892.531002:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075264 00000100:00100000:3.0:1789427892.531003:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075264 00000100:00100000:3.0:1789427892.531029:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789427892.531035:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940074496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531074:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940074496:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531080:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789427892.531090:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789427892.531095:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940074240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531120:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940074240:12345-0@lo:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531125:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789427892.531140:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789427892.531145:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940074752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531166:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940074752:12345-0@lo:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531171:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789427892.531180:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789427892.531184:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940075264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531202:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940075264:12345-0@lo:400:kworker.0 Request processed in 17us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531207:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789427892.531229:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940074240:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531238:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940074752:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531245:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940075264:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531292:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074112 00000100:00100000:3.0:1789427892.531296:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074112 00000100:00100000:3.0:1789427892.531317:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789427892.531322:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940074112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531350:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940074112:12345-0@lo:400:kworker.0 Request processed in 28us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531355:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789427892.531382:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531396:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075008 00000100:00100000:3.0:1789427892.531399:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075008 00000100:00100000:3.0:1789427892.531605:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075520 00000100:00100000:3.0:1789427892.531614:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075520 00000100:00100000:3.0:1789427892.531632:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075136 00000100:00100000:3.0:1789427892.531634:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075136 00000100:00100000:3.0:1789427892.531645:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789427892.531650:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940075008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531677:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940075008:12345-0@lo:400:kworker.0 Request processed in 27us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531682:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789427892.531691:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789427892.531695:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940075520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531713:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940075520:12345-0@lo:400:kworker.0 Request processed in 18us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531718:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789427892.531726:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789427892.531731:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940075136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.531751:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940075136:12345-0@lo:400:kworker.0 Request processed in 21us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.531757:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789427892.531777:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940075136:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.531918:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.531954:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940074880:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.531978:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.531996:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940075392:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.532027:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427892.532049:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940074496:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.532058:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940075008:0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.532177:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074368 00000100:00100000:3.0:1789427892.532182:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074368 00000100:00100000:3.0:1789427892.532205:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789427892.532211:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940074368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.532241:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940074368:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.532247:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789427892.532315:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940075520:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.532338:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940074368:0@lo:400:kworker.0 00000100:00100000:0.0:1789427892.532354:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940074880 00000100:00100000:0.0:1789427892.532357:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940074880 00000100:00100000:0.0:1789427892.532388:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075392 00000100:00100000:0.0:1789427892.532392:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075392 00000100:00100000:0.0:1789427892.533034:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789427892.533048:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940074880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.533147:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789427892.533156:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940075392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427892.533201:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940075392:12345-0@lo:400:kworker.0 Request processed in 47us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.533207:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789427892.533274:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940074880:12345-0@lo:400:kworker.0 Request processed in 231us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.533281:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00080000:0.0:1789427892.533312:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfaa9880 x1876350940074880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427892.533324:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940074880:0@lo:400:kworker.0 00010000:00080000:0.0:1789427892.533335:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfaa9180 x1876350940075392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427892.533342:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940075392:0@lo:400:kworker.0 00000100:00100000:1.0:1789427892.533971:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427892.533983:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427892.534033:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789427892.534177:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427892.534181:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427892.534184:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427892.534187:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427892.535363:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940075648 00000100:00100000:0.0:1789427892.535372:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940075648 00000100:00100000:2.0:1789427892.535550:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427892.535561:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940075648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427892.535583:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427892.535672:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940075648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.535679:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427892.535722:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940075648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427892.536102:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.536297:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602432 00000100:00100000:0.0:1789427892.536303:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602432 00000100:00100000:0.0:1789427892.536336:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789427892.536343:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:11112:x1876350931602432:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789427892.536353:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.536371:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b5a expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.536406:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.536729:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427892.536734:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427892.536741:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.536774:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.536788:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427892.536802:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8402:1876350940075776:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427892.537589:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427892.543866:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8402:1876350940075776:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427892.543907:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.543929:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f000, rc 0) 00000100:00100000:3.0:1789427892.544002:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:11112:x1876350931602432:12345-192.168.202.24@tcp:101:bash.0 Request processed in 7658us (7902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427892.544175:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.544293:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1789427892.546182:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602560 00000100:00100000:2.0:1789427892.546195:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602560 00010000:00010000:2.0:1789427892.546237:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427892.546283:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:2.0:1789427892.546294:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688830c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931602560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427892.546308:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427892.546329:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.546343:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.546364:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede5186c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b53 expref: 8 pid: 8401 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.546380:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427892.546384:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427892.546391:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.548157:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.548211:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427892.548227:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1876350940075904:192.168.202.24@tcp:105: 00000100:00100000:2.0:1789427892.548323:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427892.556380:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1876350940075904:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789427892.556411:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427892.556501:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688830c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931602560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 10208us (12326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.556513:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1789427892.569761:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427892.571780:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931602816 00000100:00100000:2.0:1789427892.571795:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931602816 00000100:00100000:2.0:1789427892.571865:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789427892.571876:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:11112:x1876350931602816:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1789427892.573018:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+15:11112:x1876350931602816:12345-192.168.202.24@tcp:35:bash.0 Request processed in 1131us (3253us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789427892.573028:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000040:00080000:2.0:1789427892.594860:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789427892.657121:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789427892.657260:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427892.796452:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.796585:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931603072 00000100:00100000:3.0:1789427892.796597:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931603072 00000100:00100000:3.0:1789427892.796678:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:3.0:1789427892.796691:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+15:11122:x1876350931603072:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427892.796723:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427892.796748:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede5186d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b61 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427892.796900:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789427892.797179:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede5186d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b61 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.797209:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:3.0:1789427892.797267:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427892.797274:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede5186d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b61 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.797294:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ac00, rc 0) 00000100:00100000:3.0:1789427892.797497:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+16:11122:x1876350931603072:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 807us (1058us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789427892.797506:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789427892.811358:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.814284:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931603328 00000100:00100000:0.0:1789427892.814303:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931603328 00000100:00100000:0.0:1789427892.814525:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1789427892.814538:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+16:11122:x1876350931603328:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427892.815180:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+17:11122:x1876350931603328:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 644us (3835us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789427892.815506:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789427892.926820:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.944039:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931603456 00000100:00100000:0.0:1789427892.944063:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931603456 00000100:00100000:0.0:1789427892.944195:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:0.0:1789427892.944220:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+17:11128:x1876350931603456:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427892.944254:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.944284:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede5186e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b68 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944374:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944392:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944409:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427892.944488:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789427892.944493:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427892.944515:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944547:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede5186e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b68 expref: 19 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944572:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b68 expref: 18 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.944607:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427892.944611:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427892.944616:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fe00, rc 0) 00000100:00100000:0.0:1789427892.944917:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:11128:x1876350931603456:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 711us (18111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.944926:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1789427892.961882:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427892.962607:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931603712 00000100:00100000:2.0:1789427892.962633:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931603712 00000100:00100000:2.0:1789427892.962711:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:2.0:1789427892.962723:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:11128:x1876350931603712:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427892.962750:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427892.962777:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5186f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b6f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.962917:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5186f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.962934:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5186f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.962971:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5186f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427892.962985:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789427892.963270:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5186f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b6f expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.963291:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5186f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b6f expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.963301:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:2.0:1789427892.963304:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427892.963308:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427892.963523:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:11128:x1876350931603712:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 800us (1652us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789427892.963531:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1789427892.967040:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.967212:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931603968 00000100:00100000:0.0:1789427892.967224:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931603968 00000100:00100000:0.0:1789427892.967293:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:0.0:1789427892.967306:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+20:11128:x1876350931603968:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427892.967333:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.967358:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b76 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.967516:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.967534:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.967546:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427892.967559:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789427892.967674:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518706 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b76 expref: 23 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.967712:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b76 expref: 22 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.967720:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:0.0:1789427892.967723:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789427892.967727:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ea00, rc 0) 00000100:00100000:0.0:1789427892.967792:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+22:11128:x1876350931603968:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 488us (761us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789427892.967800:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:0.0:1789427892.980620:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427892.980667:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427892.981230:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604096 00000100:00100000:3.0:1789427892.981243:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604096 00000100:00100000:3.0:1789427892.981319:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:3.0:1789427892.981332:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931604096:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:3.0:1789427892.981392:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.981457:0:13777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.981468:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427892.981474:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427892.981479:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.981523:0:13777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.981558:0:13777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 7 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427892.981576:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940076032:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427892.981696:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968570d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427892.982301:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604224 00000100:00100000:1.0:1789427892.982308:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604224 00000100:00100000:1.0:1789427892.982367:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1789427892.982376:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+22:2396:x1876350931604224:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427892.982388:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427892.982448:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5186f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b6f expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.982470:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:1.0:1789427892.982476:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427892.982511:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+21:2396:x1876350931604224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 137us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427892.982519:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1789427892.987179:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427892.988137:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604352 00000100:00100000:2.0:1789427892.988148:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604352 00002000:00100000:2.0:1789427892.988205:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9196bfae1500 x1876350931604352/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:138/0 lens 504/0 e 0 to 0 dl 1789427903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427892.988226:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae1500 with x1876350931604352 ext(0->12) 00010000:00010000:2.0:1789427892.988235:0:8405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 8 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.988253:0:8405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 8 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427892.988261:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9196bfae1500 00000100:00100000:2.0:1789427892.988296:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789427892.988316:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931604352:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:3.0:1789427892.988858:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bcbbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940076032:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427892.988893:0:13777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789427892.990398:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000100:00100000:1.0:1789427892.991360:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931604352:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 3041us (4184us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789427892.991377:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00002000:00100000:1.0:1789427892.991388:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9196bfae1500 x1876350931604352/t4294967300(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:138/0 lens 504/448 e 0 to 0 dl 1789427903 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427892.991399:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae1500 with x1876350931604352 ext(0->12) 00010000:00010000:1.0:1789427892.991407:0:8405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.991478:0:8405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427892.991486:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9196bfae1500 00000100:00100000:1.0:1789427893.001174:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.001262:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604480 00000100:00100000:2.0:1789427893.001271:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604480 00010000:00010000:2.0:1789427893.001309:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.001354:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:2.0:1789427893.001362:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931604480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427893.001374:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789427893.001389:0:6469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789427893.001391:0:6469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789427892 00002000:00010000:2.0:1789427893.001392:0:6469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789427892 00002000:00010000:2.0:1789427893.001394:0:6469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789427892 00002000:00010000:2.0:1789427893.001405:0:6469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789427893.001410:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.001465:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.001488:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004657e5fb/0x84fc867ede5186ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b5a expref: 9 pid: 8402 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.001504:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427893.001509:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427893.001514:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.001524:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.001547:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427893.001589:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931604480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427893.001597:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00010000:00010000:3.0:1789427893.001715:0:13777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001725:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001745:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001754:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001761:0:13777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001780:0:13777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ac00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427893.001785:0:13777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001794:0:13777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001806:0:13777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.001813:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000785d5cb9/0x84fc867ede51871b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427893.001875:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931604096:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 20545us (21267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.001882:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1789427893.016750:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.016944:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604736 00000100:00100000:2.0:1789427893.016954:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604736 00000100:00100000:2.0:1789427893.017013:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789427893.017025:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+21:11128:x1876350931604736:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:2.0:1789427893.017099:0:6485:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b76 expref: 21 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427893.017313:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789427893.017360:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789427893.018355:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789427893.018393:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.018406:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 25 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.019330:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.019374:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 25 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.019389:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 25 pid: 6482 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.019404:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6485:1876350940076160:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427893.019649:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427893.027584:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427893.027681:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604864 00000100:00100000:1.0:1789427893.027690:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604864 00010000:00010000:1.0:1789427893.027739:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 26 pid: 6482 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.027781:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:1.0:1789427893.027791:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+26:2396:x1876350931604864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427893.027807:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427893.027814:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 26 pid: 6482 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.027827:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 26 pid: 6482 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.027849:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:1.0:1789427893.027854:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.027863:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.027888:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.027908:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427893.027978:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+26:2396:x1876350931604864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 186us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.027985:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00010000:00010000:0.0:1789427893.029937:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5186b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b4c expref: 25 pid: 6482 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427893.029964:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6485:1876350940076160:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427893.029988:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.029998:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.030015:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427893.030620:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789427893.030806:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789427893.030907:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6485:1876350940076288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789427893.031046:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.031186:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427893.035908:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940076288 00000100:00100000:3.0:1789427893.035923:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940076288 00000100:00100000:2.0:1789427893.043628:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789427893.043641:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6485:x1876350940076288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789427893.043775:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6485:x1876350940076288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (12729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427893.043782:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789427893.043914:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6485:1876350940076288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789427893.044129:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789427893.044192:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6485:1876350940076416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789427893.044224:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.044251:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196989299c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427893.044388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940076416 00000100:00100000:3.0:1789427893.044396:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940076416 00000100:00100000:3.0:1789427893.044458:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789427893.044466:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1876350940076416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789427893.044576:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6485:x1876350940076416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (350us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789427893.044582:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789427893.044716:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6485:1876350940076416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789427893.044759:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789427893.044801:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044811:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044818:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044824:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427893.044828:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044835:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044849:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:1.0:1789427893.044852:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789427893.044857:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.044872:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518722 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427893.044967:0:6485:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789427893.045030:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789427893.045041:0:6485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237539625228ns, next at 238539623343ns, rc = 0 00000001:00080000:1.0:1789427893.045047:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789427893.045076:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fb00) 00010000:00010000:1.0:1789427893.045080:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427893.045087:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51870d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b76 expref: 29 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.045185:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+28:11128:x1876350931604736:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 28162us (28443us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789427893.045196:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000020:00080000:1.0:1789427893.045200:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789427893.047980:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427893.052604:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931604992 00000100:00100000:3.0:1789427893.052618:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931604992 00000100:00100000:3.0:1789427893.052682:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:3.0:1789427893.052692:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+28:11128:x1876350931604992:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427893.052715:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427893.052739:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518729 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b7d expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.052793:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b7d expref: 29 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.052808:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b7d expref: 29 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.052825:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427893.052828:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427893.052831:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ac00, rc 0) 00000100:00100000:3.0:1789427893.052887:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+29:11128:x1876350931604992:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 196us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.052895:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1789427893.056234:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.056359:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931605248 00000100:00100000:2.0:1789427893.056369:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931605248 00000100:00100000:2.0:1789427893.056457:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1789427893.056466:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:11128:x1876350931605248:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427893.056681:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+30:11128:x1876350931605248:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 215us (454us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789427893.056688:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789427893.157060:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427893.157199:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931605504 00000100:00100000:3.0:1789427893.157209:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931605504 00000100:00100000:3.0:1789427893.157271:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1789427893.157282:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+30:11138:x1876350931605504:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427893.157306:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427893.157327:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b84 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427893.157477:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789427893.157576:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518730 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b84 expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.157590:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:3.0:1789427893.157593:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427893.157599:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b84 expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.157614:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a200, rc 0) 00000100:00100000:3.0:1789427893.157670:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+31:11138:x1876350931605504:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 390us (620us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1789427893.157677:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1789427893.162345:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427893.162471:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931605632 00000100:00100000:0.0:1789427893.162481:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931605632 00000100:00100000:0.0:1789427893.162528:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:0.0:1789427893.162537:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+31:11138:x1876350931605632:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:0.0:1789427893.162603:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162619:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162631:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162643:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162651:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162658:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162759:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162768:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162775:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427893.162819:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162831:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162839:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162847:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162853:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427893.162858:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162865:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162875:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427893.162879:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427893.162883:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162896:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede51873e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162910:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162916:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162923:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162927:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427893.162931:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162937:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162945:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:0.0:1789427893.162948:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427893.162951:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162957:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518745 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162966:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162972:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162985:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.162991:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427893.162993:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.163000:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.163022:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427893.163025:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427893.163028:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.163035:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51874c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427893.163279:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+31:11138:x1876350931605632:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 741us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.163287:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1789427893.166246:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.166327:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931605888 00000100:00100000:2.0:1789427893.166335:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931605888 00000100:00100000:2.0:1789427893.166386:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1789427893.166396:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+31:11138:x1876350931605888:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427893.166612:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+32:11138:x1876350931605888:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 217us (372us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789427893.166620:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1789427893.224393:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.224506:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931606144 00000100:00100000:2.0:1789427893.224522:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931606144 00000100:00100000:2.0:1789427893.224605:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:2.0:1789427893.224616:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+32:11141:x1876350931606144:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427893.224638:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427893.224657:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518753 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b8b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224723:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224737:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224761:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224772:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224779:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224785:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224883:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224890:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224897:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427893.224906:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789427893.224973:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224980:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224986:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.224992:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427893.225092:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225102:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225114:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427893.225117:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427893.225122:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225128:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51875a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225140:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225146:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225152:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225157:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427893.225160:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225166:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225174:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:2.0:1789427893.225176:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427893.225185:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225192:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225226:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518753 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 35 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225239:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 34 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.225246:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:2.0:1789427893.225248:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427893.225251:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429e00, rc 0) 00000100:00100000:2.0:1789427893.226596:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+34:11141:x1876350931606144:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1975us (2211us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789427893.226606:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1789427893.232111:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427893.232454:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931606272 00000100:00100000:0.0:1789427893.232469:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931606272 00000100:00100000:0.0:1789427893.232542:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1789427893.232554:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+34:11141:x1876350931606272:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:0.0:1789427893.232635:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232652:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232676:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232709:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232716:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232722:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232728:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427893.232732:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232740:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232751:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427893.232754:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427893.232760:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.232766:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427893.232851:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+34:11141:x1876350931606272:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 295us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.232860:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1789427893.236967:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.237152:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931606528 00000100:00100000:2.0:1789427893.237167:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931606528 00000100:00100000:2.0:1789427893.237239:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789427893.237252:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+34:11141:x1876350931606528:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427893.237713:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+35:11141:x1876350931606528:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 462us (757us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789427893.237722:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1789427893.552768:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789427893.552800:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940076544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427893.552889:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427893.552981:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940076672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427893.553019:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.554510:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940076544 00000100:00100000:0.0:1789427893.554527:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940076544 00000100:00100000:0.0:1789427893.554601:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940076672 00000100:00100000:0.0:1789427893.554605:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940076672 00000100:00100000:0.0:1789427893.554627:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789427893.554656:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940076544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427893.554700:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427893.554763:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940076544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.554772:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789427893.554789:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789427893.554795:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940076672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427893.554805:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427893.554825:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940076672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.554831:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789427893.555053:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940076672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427893.555087:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940076544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427893.584102:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427893.584206:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931606784 00000100:00100000:3.0:1789427893.584220:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931606784 00000100:00100000:3.0:1789427893.584295:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789427893.584307:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+35:11172:x1876350931606784:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:3.0:1789427893.584340:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427893.584384:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51877d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b92 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.584559:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518784 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.584577:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.584594:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427893.584606:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789427893.584767:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51877d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b92 expref: 38 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.584791:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b92 expref: 37 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.584802:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427893.584805:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427893.584809:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883bc00, rc 0) 00000100:00100000:3.0:1789427893.584876:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:11172:x1876350931606784:12345-192.168.202.24@tcp:101:cat.0 Request processed in 571us (787us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789427893.584883:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789427893.591151:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.591297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931606912 00000100:00100000:2.0:1789427893.591311:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931606912 00000100:00100000:2.0:1789427893.591399:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1789427893.591411:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:2394:x1876350931606912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427893.591479:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427893.591511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518784 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b92 expref: 37 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.591536:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:2.0:1789427893.591541:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427893.591604:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+36:2394:x1876350931606912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 195us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427893.591612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789427893.594738:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.594958:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931607168 00000100:00100000:2.0:1789427893.594970:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931607168 00000100:00100000:2.0:1789427893.595043:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789427893.595056:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+36:11172:x1876350931607168:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:2.0:1789427893.595354:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+37:11172:x1876350931607168:12345-192.168.202.24@tcp:35:cat.0 Request processed in 300us (626us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789427893.595363:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1789427893.670357:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.671063:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931607424 00000100:00100000:2.0:1789427893.671078:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931607424 00000100:00100000:2.0:1789427893.671245:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1789427893.671258:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+37:11178:x1876350931607424:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789427893.671291:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427893.671295:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789427893.671330:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5186ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b68 expref: 37 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671353:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427893.671375:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427893.671394:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518792 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300b99 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671581:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671600:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 37 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671609:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671651:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 37 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.671668:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 37 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.671684:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940076800:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427893.671805:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789427893.680689:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427893.685737:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427893.685814:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931607552 00000100:00100000:1.0:1789427893.685827:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931607552 00010000:00010000:1.0:1789427893.685885:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 38 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.685958:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1789427893.685969:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+38:2396:x1876350931607552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427893.685988:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789427893.685990:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940076800:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427893.686006:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 38 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.686019:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 38 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.686031:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.686047:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b8b expref: 38 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.689771:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427893.689791:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.689810:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.689820:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.689873:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427893.690038:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+37:2396:x1876350931607552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4063us (4308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.690052:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00010000:00010000:2.0:1789427893.690121:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.690130:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427893.690228:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789427893.692070:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518792 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 38 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.692099:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 37 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.692108:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:2.0:1789427893.692111:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427893.692115:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789427893.692237:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+37:11178:x1876350931607424:12345-192.168.202.24@tcp:101:dd.0 Request processed in 20981us (21895us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789427893.692248:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:3.0:1789427893.694166:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427893.694615:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931607680 00000100:00100000:0.0:1789427893.694626:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931607680 00000100:00100000:0.0:1789427893.694791:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:0.0:1789427893.694804:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+37:11178:x1876350931607680:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789427893.694832:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427893.694857:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede5187a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ba0 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.694898:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.694927:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.694941:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.695088:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede5187a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 39 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.695107:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 38 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.695115:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427893.695118:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427893.695122:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f600, rc 0) 00000100:00100000:0.0:1789427893.695194:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+38:11178:x1876350931607680:12345-192.168.202.24@tcp:101:dd.0 Request processed in 393us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.695342:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:1.0:1789427893.699725:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427893.699814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931607936 00000100:00100000:0.0:1789427893.699828:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931607936 00000100:00100000:0.0:1789427893.699902:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1789427893.699913:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+38:11178:x1876350931607936:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:0.0:1789427893.700248:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.700279:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.700305:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427893.700355:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789427893.700383:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000190b0830 reply state 0000000029ff3e7f transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.700397:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.700405:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427893.700407:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427893.700412:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427893.700576:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+41:11178:x1876350931607936:12345-192.168.202.24@tcp:36:dd.0 Request processed in 664us (864us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789427893.700585:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000020:00080000:0.0:1789427893.700591:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789427893.939057:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.939186:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931608064 00000100:00100000:2.0:1789427893.939200:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931608064 00000100:00100000:2.0:1789427893.939277:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:2.0:1789427893.939289:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+41:11192:x1876350931608064:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:2.0:1789427893.939322:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427893.939351:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5187bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ba7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939476:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939495:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939530:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939545:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939554:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939561:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939676:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939689:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 42 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939700:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939740:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 42 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.939756:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 42 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.939771:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940076928:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427893.940275:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427893.943095:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940076928:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427893.943131:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.946292:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427893.946778:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931608320 00000100:00100000:2.0:1789427893.946791:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931608320 00000100:00100000:2.0:1789427893.946864:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1789427893.946875:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+43:6154:x1876350931608320:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789427893.947327:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+44:6154:x1876350931608320:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 454us (1049us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789427893.947337:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1789427893.963608:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427893.963740:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931608448 00000100:00100000:1.0:1789427893.963753:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931608448 00010000:00010000:1.0:1789427893.963808:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 44 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.963861:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1789427893.963874:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+44:2394:x1876350931608448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427893.963894:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427893.963902:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 44 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.963917:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 44 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.963953:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518799 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b99 expref: 44 pid: 6483 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.963975:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427893.963981:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.964000:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.964010:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.964080:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427893.964158:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+43:2394:x1876350931608448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 285us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.964166:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00010000:00010000:3.0:1789427893.964775:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.964786:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427893.964858:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789427893.964864:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427893.964943:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965018:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965031:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965038:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965044:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965106:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427893.965112:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965121:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965134:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427893.965137:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427893.965149:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965157:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5187c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965169:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965176:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965183:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965188:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427893.965192:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965198:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965207:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:3.0:1789427893.965209:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427893.965213:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965219:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede5187ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965260:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5187bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba7 expref: 43 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965292:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba7 expref: 42 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.965300:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427893.965302:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427893.965305:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:3.0:1789427893.965359:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+42:11192:x1876350931608064:12345-192.168.202.24@tcp:101:stat.0 Request processed in 26073us (26318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.965367:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:3.0:1789427894.058935:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.059167:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931608704 00000100:00100000:0.0:1789427894.059182:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931608704 00000100:00100000:0.0:1789427894.059324:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1789427894.059339:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+42:11198:x1876350931608704:12345-192.168.202.24@tcp:36:truncate.0 00010000:00010000:0.0:1789427894.059462:0:10064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427894.059496:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede5187d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba7 expref: 42 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.059523:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.059529:0:10064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427894.059829:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.059863:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.059876:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427894.059932:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1789427894.059958:0:10064:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001755a582 reply state 000000000755b0eb transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.059972:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.059978:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.059982:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427894.059984:0:10064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427894.060145:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+44:11198:x1876350931608704:12345-192.168.202.24@tcp:36:truncate.0 Request processed in 809us (1224us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789427894.060153:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000020:00080000:0.0:1789427894.060159:0:10064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1789427894.060895:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427894.209020:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427894.209182:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931608832 00000100:00100000:3.0:1789427894.209204:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931608832 00000100:00100000:3.0:1789427894.209286:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:3.0:1789427894.209298:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+44:11212:x1876350931608832:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:3.0:1789427894.209328:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427894.209354:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede5187df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bae expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209483:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209500:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209513:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209548:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209557:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209563:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209646:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209655:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209663:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427894.209712:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789427894.209717:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427894.209738:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209752:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209760:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209768:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209785:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209792:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427894.209796:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209804:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209818:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427894.209821:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427894.209827:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209834:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5187e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209849:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209856:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209862:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209867:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883bc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427894.209870:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209884:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209892:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:3.0:1789427894.209894:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427894.209898:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209904:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5187ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209946:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede5187df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209961:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.209969:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427894.209971:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427894.209973:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b400, rc 0) 00000100:00100000:3.0:1789427894.210466:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+45:11212:x1876350931608832:12345-192.168.202.24@tcp:101:stat.0 Request processed in 1169us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427894.210476:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:3.0:1789427894.276160:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.276518:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931609088 00000100:00100000:0.0:1789427894.276530:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931609088 00000100:00100000:0.0:1789427894.276611:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1789427894.276622:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+45:11222:x1876350931609088:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427894.276651:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427894.276677:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5187fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bb5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.276821:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789427894.276962:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5187fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bb5 expref: 47 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.276979:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:0.0:1789427894.276985:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427894.277000:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5187fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bb5 expref: 47 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.277018:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e800, rc 0) 00000100:00100000:0.0:1789427894.277102:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+46:11222:x1876350931609088:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 482us (964us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1789427894.277110:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:3.0:1789427894.280685:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.280791:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931609344 00000100:00100000:0.0:1789427894.280803:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931609344 00000100:00100000:0.0:1789427894.280867:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:0.0:1789427894.280878:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+46:11222:x1876350931609344:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427894.281669:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+47:11222:x1876350931609344:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 790us (993us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789427894.281679:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1789427894.366999:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.367701:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931609600 00000100:00100000:0.0:1789427894.367714:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931609600 00000100:00100000:0.0:1789427894.367792:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1789427894.367804:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+47:11228:x1876350931609600:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789427894.367838:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427894.367881:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518809 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bbc expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.368533:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.368554:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.368564:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.369028:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.369108:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 48 pid: 6484 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427894.369128:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940077056:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427894.369300:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcbbb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427894.376183:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940077056:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427894.376213:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.382118:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.382537:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931609728 00000100:00100000:1.0:1789427894.382550:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931609728 00010000:00010000:1.0:1789427894.382608:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 49 pid: 6484 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.383045:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1789427894.383058:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688833c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+49:2395:x1876350931609728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427894.383077:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427894.383085:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 49 pid: 6484 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383101:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 49 pid: 6484 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383138:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5187f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bae expref: 49 pid: 6484 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383160:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427894.383167:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383179:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383206:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.383239:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427894.383288:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.383316:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688833c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+48:2395:x1876350931609728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 260us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.383326:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00010000:00010000:0.0:1789427894.386376:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.386441:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789427894.386582:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518809 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 49 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.386605:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 48 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.386614:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.386617:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789427894.386620:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fc00, rc 0) 00000100:00100000:0.0:1789427894.386695:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+48:11228:x1876350931609600:12345-192.168.202.24@tcp:101:bash.0 Request processed in 18892us (19784us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789427894.386705:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1789427894.392811:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.392878:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931609984 00000100:00100000:1.0:1789427894.392895:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931609984 00000100:00100000:1.0:1789427894.392974:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:1.0:1789427894.392986:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+48:11228:x1876350931609984:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:1.0:1789427894.393327:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.393361:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.393376:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427894.393463:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789427894.393491:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028ecb7b4 reply state 00000000b6e24355 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.393506:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.393516:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427894.393519:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427894.393540:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427894.394253:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+51:11228:x1876350931609984:12345-192.168.202.24@tcp:36:bash.0 Request processed in 1266us (1446us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789427894.394262:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000020:00080000:1.0:1789427894.394269:0:8108:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789427894.403308:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427894.403395:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931610112 00000100:00100000:3.0:1789427894.403442:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931610112 00000100:00100000:3.0:1789427894.403493:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:3.0:1789427894.403502:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+51:11228:x1876350931610112:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427894.403524:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427894.403545:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518825 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bc3 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.403631:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.403645:0:10064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 52 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.403654:0:10064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.403686:0:10064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 52 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.403700:0:10064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 52 pid: 6482 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.403713:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940077184:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427894.403814:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968570d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427894.408386:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940077184:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427894.408454:0:10064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427894.409867:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.410026:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931610240 00000100:00100000:1.0:1789427894.410035:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931610240 00010000:00010000:1.0:1789427894.410081:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 53 pid: 6482 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.410117:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:1.0:1789427894.410126:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+53:2397:x1876350931610240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427894.410153:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427894.410160:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 53 pid: 6482 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410171:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 53 pid: 6482 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410192:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518810 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bbc expref: 53 pid: 6482 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410208:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427894.410213:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410222:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410243:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.410271:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427894.410322:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+52:2397:x1876350931610240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 196us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.410329:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00010000:00010000:0.0:1789427894.410558:0:10064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.410567:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.410616:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789427894.410620:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427894.410641:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.410672:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518825 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bc3 expref: 52 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.410701:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bc3 expref: 51 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.410709:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.410712:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427894.410714:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883bc00, rc 0) 00000100:00100000:0.0:1789427894.410741:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+51:11228:x1876350931610112:12345-192.168.202.24@tcp:101:bash.0 Request processed in 7240us (7443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.410748:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1789427894.415880:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.415969:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931610496 00000100:00100000:1.0:1789427894.415979:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931610496 00000100:00100000:1.0:1789427894.416045:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:1.0:1789427894.416064:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+51:11228:x1876350931610496:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:1.0:1789427894.416285:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+52:11228:x1876350931610496:12345-192.168.202.24@tcp:35:bash.0 Request processed in 221us (412us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789427894.416294:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:2.0:1789427894.499506:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.499599:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931610752 00000100:00100000:0.0:1789427894.499609:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931610752 00000100:00100000:0.0:1789427894.499672:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:0.0:1789427894.499682:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+52:11238:x1876350931610752:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427894.499705:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427894.499725:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bca expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.499820:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789427894.499913:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518833 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bca expref: 54 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.499926:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:0.0:1789427894.499928:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427894.499933:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bca expref: 54 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.499974:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e800, rc 0) 00000100:00100000:0.0:1789427894.500067:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+53:11238:x1876350931610752:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 386us (569us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1789427894.500075:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1789427894.502761:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.503336:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931610880 00000100:00100000:1.0:1789427894.503345:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931610880 00000100:00100000:1.0:1789427894.503393:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:1.0:1789427894.503401:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+53:11238:x1876350931610880:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:1.0:1789427894.503477:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503493:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503505:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503516:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503536:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503544:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503613:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503622:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503628:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427894.503667:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503679:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503684:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503688:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503691:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427894.503694:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503699:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503713:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:1.0:1789427894.503715:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.503719:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503723:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503730:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503734:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503737:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503740:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427894.503742:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503745:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503748:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:1.0:1789427894.503750:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.503751:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503754:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503766:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503770:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503774:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503776:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427894.503778:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503781:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503785:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427894.503786:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.503787:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.503790:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede51884f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.503839:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+53:11238:x1876350931610880:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 437us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.503846:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:2.0:1789427894.505888:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.506045:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931611136 00000100:00100000:1.0:1789427894.506105:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931611136 00000100:00100000:1.0:1789427894.506215:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1789427894.506236:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+53:11238:x1876350931611136:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789427894.506405:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+54:11238:x1876350931611136:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 171us (520us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789427894.506412:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789427894.534480:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.534600:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931611392 00000100:00100000:0.0:1789427894.534609:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931611392 00000100:00100000:0.0:1789427894.534666:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:0.0:1789427894.534676:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+54:11241:x1876350931611392:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427894.534698:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427894.534718:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518856 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bd1 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534788:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534802:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534815:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534825:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534831:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534837:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534958:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede51886b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534967:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede51886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.534975:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede51886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.534986:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789427894.535078:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535086:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535093:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535100:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427894.535104:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535111:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535123:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427894.535126:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427894.535130:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535172:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51885d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535185:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535192:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535197:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535202:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427894.535205:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535210:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535218:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:0.0:1789427894.535220:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427894.535223:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535229:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535263:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd1 expref: 57 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535290:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede51886b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd1 expref: 56 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.535298:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.535300:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427894.535302:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e400, rc 0) 00000100:00100000:0.0:1789427894.535360:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+56:11241:x1876350931611392:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 684us (889us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789427894.535367:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:2.0:1789427894.538625:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427894.538704:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931611520 00000100:00100000:3.0:1789427894.538716:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931611520 00000100:00100000:3.0:1789427894.538756:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:3.0:1789427894.538764:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bface680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+56:11241:x1876350931611520:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1789427894.538806:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538820:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538829:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538851:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538858:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538865:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538870:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427894.538874:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538881:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538890:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427894.538892:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427894.538896:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.538912:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.538977:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bface680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+56:11241:x1876350931611520:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 213us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427894.538984:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:2.0:1789427894.540813:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.540882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931611648 00000100:00100000:0.0:1789427894.540888:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931611648 00000100:00100000:0.0:1789427894.540943:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789427894.540952:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+56:2395:x1876350931611648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427894.540964:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427894.540981:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede51886b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd1 expref: 56 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.541005:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.541009:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427894.541046:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+55:2395:x1876350931611648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.541061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:2.0:1789427894.543463:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.543646:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931611904 00000100:00100000:0.0:1789427894.543653:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931611904 00000100:00100000:0.0:1789427894.543683:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1789427894.543701:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+55:11241:x1876350931611904:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427894.543873:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+56:11241:x1876350931611904:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 171us (413us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789427894.543880:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1789427894.576689:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427894.576760:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427894.576902:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940077312 00000100:00100000:3.0:1789427894.576910:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940077312 00000100:00100000:3.0:1789427894.576970:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427894.576980:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940077312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427894.577023:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789427894.577086:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940077312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427894.577094:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789427894.577266:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427894.659829:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427894.659936:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931612160 00000100:00100000:1.0:1789427894.659946:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931612160 00000100:00100000:1.0:1789427894.660012:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:1.0:1789427894.660023:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+56:11259:x1876350931612160:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:1.0:1789427894.660054:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427894.660076:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede518880 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bd8 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.660191:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518887 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.660206:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.660218:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427894.660228:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789427894.660324:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede518880 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd8 expref: 59 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.660360:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd8 expref: 58 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.660368:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427894.660371:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789427894.660375:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46000, rc 0) 00000100:00100000:1.0:1789427894.660476:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+58:11259:x1876350931612160:12345-192.168.202.24@tcp:101:cat.0 Request processed in 455us (656us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789427894.660483:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:2.0:1789427894.681036:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427894.681133:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931612288 00000100:00100000:3.0:1789427894.681155:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931612288 00000100:00100000:3.0:1789427894.681215:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 75 00000100:00100000:3.0:1789427894.681226:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+58:11260:x1876350931612288:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427894.681247:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427894.681266:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bdf expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681333:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681347:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681377:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427894.681446:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789427894.681450:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427894.681466:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681490:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bdf expref: 60 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681508:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bdf expref: 59 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.681517:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427894.681520:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427894.681523:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ba00, rc 0) 00000100:00100000:3.0:1789427894.681580:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+59:11260:x1876350931612288:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 356us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427894.681587:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 75 00000100:00100000:2.0:1789427894.686983:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.687089:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931612672 00000100:00100000:0.0:1789427894.687098:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931612672 00000100:00100000:0.0:1789427894.687165:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1789427894.687175:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11260:x1876350931612672:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427894.687627:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+60:11260:x1876350931612672:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 453us (651us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789427894.687635:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:2.0:1789427894.689454:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427894.689525:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931612800 00000100:00100000:3.0:1789427894.689533:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931612800 00000100:00100000:3.0:1789427894.689581:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1789427894.689590:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+60:11260:x1876350931612800:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:3.0:1789427894.689601:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789427894.689624:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede51882c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bc3 expref: 60 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.689663:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518887 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bd8 expref: 59 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.689676:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b7d expref: 58 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.689686:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427894.689691:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427894.689732:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+57:11260:x1876350931612800:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427894.689739:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789427894.691909:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.692076:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931612928 00000100:00100000:0.0:1789427894.692083:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931612928 00000100:00100000:0.0:1789427894.692130:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:0.0:1789427894.692244:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+57:11260:x1876350931612928:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:0.0:1789427894.692339:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.692356:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.692367:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789427894.692786:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427894.692936:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789427894.693042:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789427894.693107:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+57:11260:x1876350931612928:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 970us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.693121:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76 00010000:00010000:1.0:1789427894.705257:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427894.712397:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427894.712521:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613056 00000100:00100000:0.0:1789427894.712531:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613056 00000100:00100000:0.0:1789427894.712585:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:0.0:1789427894.712594:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+57:11262:x1876350931613056:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427894.712613:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427894.712633:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5188aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300be6 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712693:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712707:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712717:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712728:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712735:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712742:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712813:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712832:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712840:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427894.712883:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789427894.712887:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427894.712902:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712913:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712936:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712942:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712949:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712955:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427894.712958:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712965:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.712976:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427894.712984:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427894.713000:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713007:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede5188b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713021:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713027:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713032:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713037:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427894.713040:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713057:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713064:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:0.0:1789427894.713066:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427894.713069:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713075:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713101:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5188aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 59 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713128:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 58 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.713136:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789427894.713139:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427894.713142:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e000, rc 0) 00000100:00100000:0.0:1789427894.713200:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+58:11262:x1876350931613056:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 606us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.713207:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000040:00080000:3.0:1789427895.675846:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427895.675869:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427895.675963:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789427895.675993:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427895.676403:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940077440:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427895.676888:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427895.699604:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427895.700578:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613184 00000100:00100000:2.0:1789427895.700604:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613184 00000100:00100000:2.0:1789427895.700755:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:2.0:1789427895.702268:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613184:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427895.702393:0:6483:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427895.702928:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613184:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 705us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.702949:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1789427895.710789:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940077440:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427895.711754:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427895.712911:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613312 00000100:00100000:0.0:1789427895.712959:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613312 00000100:00100000:0.0:1789427895.713383:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:0.0:1789427895.713406:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+58:11273:x1876350931613312:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789427895.713589:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.713622:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.713683:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789427895.713710:0:14170:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427895.713718:0:14170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427895.713738:0:14170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789427895.713743:0:14170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789427895.722061:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722085:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722099:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722138:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722148:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722172:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427895.722225:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789427895.722230:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427895.722244:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722257:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722263:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722271:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722277:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.722282:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722289:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722301:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427895.722305:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.722310:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722317:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5188c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722345:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722351:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722358:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722363:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.722366:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722372:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722381:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff919581d4ed00) 00010000:00010000:1.0:1789427895.722383:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.722386:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722392:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722409:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722493:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722500:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722513:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.722516:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722523:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722532:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427895.722534:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.722537:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.722543:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.722703:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+58:11273:x1876350931613312:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 9305us (10977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.722713:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00010000:00010000:0.0:1789427895.737868:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427895.738172:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.738310:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613568 00000100:00100000:3.0:1789427895.738325:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613568 00000100:00100000:1.0:1789427895.738489:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:1.0:1789427895.738516:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+58:11273:x1876350931613568:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427895.738538:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427895.738560:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bed expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.738737:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.738752:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.738770:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427895.738783:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789427895.739023:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739030:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739037:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739042:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.739046:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739053:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739065:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789427895.739069:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427895.739073:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739080:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5188e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739116:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bed expref: 60 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739135:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427895.739138:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427895.739141:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede5188db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bed expref: 60 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.739150:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47e00, rc 0) 00000100:00100000:1.0:1789427895.739219:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613568:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 718us (1056us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789427895.739226:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:1.0:1789427895.741746:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427895.741841:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613696 00000100:00100000:0.0:1789427895.741850:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613696 00000100:00100000:0.0:1789427895.741936:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:0.0:1789427895.741945:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613696:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789427895.741998:0:6483:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789427895.742144:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613696:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 199us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427895.742151:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:2.0:1789427895.751506:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.752145:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931613952 00000100:00100000:3.0:1789427895.752156:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931613952 00000100:00100000:3.0:1789427895.752214:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1789427895.752225:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931613952:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.752245:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427895.752257:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789427895.752284:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede51889c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bdf expref: 59 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752303:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427895.752308:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427895.752321:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede5188f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bf4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427895.752711:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789427895.752847:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5188f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752860:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5188f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752869:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5188f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752918:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede5188f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bf4 expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752934:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5188f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bf4 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.752941:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9196a235f300) 00010000:00010000:3.0:1789427895.752943:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427895.752946:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883bc00, rc 0) 00000100:00100000:3.0:1789427895.753022:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+60:11273:x1876350931613952:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 799us (1523us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789427895.753039:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1789427895.759308:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427895.759389:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614208 00000100:00100000:1.0:1789427895.759400:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614208 00000100:00100000:1.0:1789427895.759485:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:1.0:1789427895.759496:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:11273:x1876350931614208:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789427895.759552:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427895.759577:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede5188f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bf4 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759597:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9196a235f300) 00010000:00010000:1.0:1789427895.759607:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427895.759628:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759643:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759668:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759724:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759733:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759741:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759784:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759791:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759799:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759805:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.759809:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759817:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759825:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:1.0:1789427895.759828:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.759831:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759844:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518905 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759856:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759861:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759866:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759871:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427895.759874:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759879:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759888:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xeadf3cb5 (ffff919581d4ed00) 00010000:00010000:1.0:1789427895.759890:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.759894:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.759900:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede51890c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeadf3cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.759991:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931614208:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 486us (680us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427895.759999:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:1.0:1789427895.766975:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427895.767972:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614336 00000100:00100000:2.0:1789427895.767995:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614336 00000100:00100000:2.0:1789427895.768056:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:2.0:1789427895.768068:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:11273:x1876350931614336:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.768089:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427895.768113:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518913 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300bfb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768149:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768163:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768176:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768275:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518913 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768295:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.768304:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:2.0:1789427895.768306:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427895.768310:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427895.768369:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+60:11273:x1876350931614336:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 304us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.768376:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:2.0:1789427895.775543:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.775663:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614592 00000100:00100000:3.0:1789427895.775674:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614592 00000100:00100000:3.0:1789427895.775741:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:3.0:1789427895.775752:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+60:11273:x1876350931614592:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.775835:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.775853:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.775864:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427895.776067:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789427895.776078:0:6482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240270661889ns, next at 241270659223ns, rc = 0 00000004:00010000:3.0:1789427895.776123:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078559603 reply state 000000009d928a28 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.776136:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.776143:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:3.0:1789427895.776145:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789427895.776149:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427895.776251:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+62:11273:x1876350931614592:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 500us (720us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789427895.776259:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:3.0:1789427895.785764:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427895.785858:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614720 00000100:00100000:0.0:1789427895.785868:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614720 00000100:00100000:0.0:1789427895.785933:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:0.0:1789427895.785943:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+62:11273:x1876350931614720:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427895.785966:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427895.788533:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c02 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.788604:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 63 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.788620:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 63 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.788638:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:0.0:1789427895.788642:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427895.788645:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fc00, rc 0) 00000100:00100000:0.0:1789427895.788718:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+63:11273:x1876350931614720:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 2776us (2962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427895.788727:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:2.0:1789427895.792137:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.792244:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614848 00000100:00100000:3.0:1789427895.792261:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614848 00000100:00100000:3.0:1789427895.792323:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:3.0:1789427895.792335:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bface300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1876350931614848:12345-192.168.202.24@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789427895.792379:0:8401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1789427895.792510:0:8401:0:(genops.c:1384:class_connect()) connect: client 2f916dfa-5c35-44f7-8247-070d65680205, cookie 0x84fc867ede51892f 00002000:00100000:3.0:1789427895.792526:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f916dfa-5c35-44f7-8247-070d65680205/ffff9196bfad1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789427895.792549:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789427895.792645:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789427895.792688:0:8401:0:(import.c:65:import_set_state_nolock()) ffff9196bfad3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427895.792777:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bface300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2393:x1876350931614848:12345-192.168.202.24@tcp:8:lhsmtool_posix.0 Request processed in 443us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.792786:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:2.0:1789427895.794859:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.794957:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931614976 00000100:00100000:3.0:1789427895.794970:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931614976 00000100:00080000:2.0:1789427895.795057:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427895.795071:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1789427895.795083:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:0:x1876350931614976:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1789427895.797302:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789427895.797317:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000100:00100000:3.0:1789427895.797506:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:0:x1876350931614976:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 2420us (2651us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789427895.797518:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1789427895.806893:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.806995:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931615232 00000100:00100000:3.0:1789427895.807004:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931615232 00000100:00100000:3.0:1789427895.807120:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789427895.807131:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+63:11273:x1876350931615232:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789427895.807351:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+64:11273:x1876350931615232:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 222us (467us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789427895.807360:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1789427895.810601:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.810691:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931615488 00000100:00100000:3.0:1789427895.810701:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931615488 00000100:00100000:3.0:1789427895.810757:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:3.0:1789427895.810767:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+64:11273:x1876350931615488:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427895.811131:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+64:11273:x1876350931615488:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 364us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.811146:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:1.0:1789427895.816244:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.816365:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931615616 00000100:00100000:3.0:1789427895.816375:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931615616 00000100:00100000:3.0:1789427895.816585:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1789427895.816595:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+64:11273:x1876350931615616:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.816616:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427895.816635:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518936 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c09 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816725:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816741:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816753:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427895.816814:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427895.816834:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816861:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518936 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c09 expref: 66 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816878:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c09 expref: 65 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.816886:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:3.0:1789427895.816889:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789427895.816893:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a200, rc 0) 00000100:00100000:3.0:1789427895.817118:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+65:11273:x1876350931615616:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 523us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.817126:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:0.0:1789427895.821025:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.821212:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931615744 00000100:00100000:3.0:1789427895.821221:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931615744 00000100:00100000:3.0:1789427895.821281:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:3.0:1789427895.821292:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931615744:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.821312:0:13777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427895.821332:0:13777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c10 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427895.821355:0:13777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880b7, blocks: 0x0 00010000:00010000:3.0:1789427895.821371:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=240s v=(0 0) 00010000:00010000:3.0:1789427895.821382:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427895.821391:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 6 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.821540:0:13777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 6 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.821555:0:13777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b400, rc 0) 00000100:00100000:3.0:1789427895.821691:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931615744:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 401us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.821699:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:1.0:1789427895.827210:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427895.827274:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616000 00000100:00100000:0.0:1789427895.827291:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616000 00000100:00100000:0.0:1789427895.827355:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:0.0:1789427895.827366:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+65:11273:x1876350931616000:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789427895.827496:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+65:11273:x1876350931616000:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 130us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427895.827503:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:3.0:1789427895.836965:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427895.837230:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616128 00000100:00100000:0.0:1789427895.837240:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616128 00000100:00100000:0.0:1789427895.837309:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:0.0:1789427895.837323:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:11273:x1876350931616128:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427895.837345:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427895.837370:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c17 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.837404:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.837439:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427895.837444:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427895.837450:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.837486:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.837500:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427895.837524:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940077568:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427895.837626:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427895.846578:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940077568:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427895.846617:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.846646:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ea00, rc 0) 00000100:00100000:3.0:1789427895.846715:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:11273:x1876350931616128:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 9396us (9759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.846724:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:1.0:1789427895.853498:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.853589:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616256 00000100:00100000:3.0:1789427895.853599:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616256 00010000:00010000:3.0:1789427895.853652:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.853705:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789427895.853725:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931616256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427895.853741:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427895.853771:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.853786:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.853809:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cec0bdf9/0x84fc867ede518944 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c10 expref: 7 pid: 13777 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.853824:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427895.853828:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427895.853835:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.853846:0:7887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.853884:0:7887:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.853899:0:7887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7887:1876350940077696:192.168.202.24@tcp:105: 00000100:00100000:3.0:1789427895.853994:0:7887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789427895.860940:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.861024:0:7887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7887:1876350940077696:192.168.202.24@tcp:105: 00010000:00010000:3.0:1789427895.861075:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427895.861128:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931616256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7406us (7637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.861140:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:0.0:1789427895.861901:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616384 00000100:00100000:0.0:1789427895.861911:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616384 00002000:00100000:0.0:1789427895.861952:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9196bfae0a80 x1876350931616384/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:141/0 lens 504/0 e 0 to 0 dl 1789427906 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789427895.861963:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae0a80 with x1876350931616384 ext(0->8) 00002000:00010000:0.0:1789427895.861968:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfae0a80 00000100:00100000:0.0:1789427895.862077:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1789427895.862087:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931616384:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789427895.864233:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931616384:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 2139us (3294us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789427895.864245:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00002000:00100000:1.0:1789427895.864258:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9196bfae0a80 x1876350931616384/t4294967303(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:141/0 lens 504/448 e 0 to 0 dl 1789427906 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427895.864267:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae0a80 with x1876350931616384 ext(0->8) 00002000:00010000:1.0:1789427895.864273:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfae0a80 00000100:00100000:1.0:1789427895.875971:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.877351:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616512 00000100:00100000:3.0:1789427895.877363:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616512 00000100:00100000:3.0:1789427895.877534:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:3.0:1789427895.877547:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+65:11273:x1876350931616512:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789427895.881581:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789427895.881596:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789427895.881614:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881628:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881637:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881644:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc179f4f0) 00000004:00080000:2.0:1789427895.881647:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789427895.881649:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881660:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789427895.881662:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff919698a01e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789427895.881670:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91968895e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff919698a01480 00000020:00080000:2.0:1789427895.881674:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91968895e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9196999c2a00 00010000:00010000:3.0:1789427895.881685:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9196a235f000) 00010000:00010000:3.0:1789427895.881690:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.881696:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881703:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518665 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881730:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881737:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881742:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881747:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.881750:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881756:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881764:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427895.881767:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.881770:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881776:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede51866c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881792:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881798:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881804:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881815:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.881818:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881824:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881833:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9196a235fa00) 00010000:00010000:3.0:1789427895.881835:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.881838:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881844:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5186ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881859:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881866:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881871:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881876:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.881878:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881884:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881902:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427895.881917:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.881921:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881927:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede5187b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881939:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881946:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881952:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881957:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ee00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.881959:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881965:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881973:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427895.881986:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.881989:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.881995:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede5187d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882016:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882022:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882028:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882043:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.882046:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882052:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882061:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427895.882063:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.882066:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882072:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51881e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882084:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882090:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882096:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882107:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ac00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427895.882110:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882116:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882123:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:3.0:1789427895.882125:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427895.882128:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.882134:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518921 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.882256:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+14:11273:x1876350931616512:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 4709us (6290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.882268:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90 00000020:00080000:0.0:1789427895.883284:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789427895.883489:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789427895.884023:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427895.884053:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940077824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789427895.884118:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427895.884162:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940077824 00000100:00100000:2.0:1789427895.884171:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940077824 00000100:00100000:1.0:1789427895.884184:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940077952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789427895.884218:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427895.884223:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789427895.884241:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940077824:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789427895.884260:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940077952 00000100:00100000:1.0:1789427895.884266:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940077952 00002000:00080000:2.0:1789427895.884267:0:8400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789427895.884296:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa880b4, atime: 0x6aa880b4, ctime: 0x6aa880b4, blocks: 0x8 00000100:00100000:1.0:1789427895.884301:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789427895.884306:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.884312:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940077952:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789427895.884329:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=240s v=(0 0) 00010000:00010000:2.0:1789427895.884333:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427895.884340:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884355:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884365:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884373:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884391:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789427895.884438:0:8902:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789427895.884442:0:8902:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789427895 00002000:00010000:1.0:1789427895.884445:0:8902:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789427895.884453:0:8902:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789427895 -> 1789427895 00002000:00010000:1.0:1789427895.884456:0:8902:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789427895.884498:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940077952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (281us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789427895.884506:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427895.884522:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876350940077824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 281us (401us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789427895.884529:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789427895.884551:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789427895.884553:0:3613:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9196bfacca80/2, rc 0, transno 4294967304 00000100:00080000:2.0:1789427895.884555:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427895.884562:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940077952:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789427895.884565:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427895.884577:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884587:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc0b8d8b0) 00000004:00080000:1.0:1789427895.884587:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9196bfaced80/2, rc 0, transno 4294967302 00010000:00010000:2.0:1789427895.884592:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.884594:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940077824:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789427895.884609:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884626:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884635:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede518952 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.884650:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427895.884652:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427895.884653:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427895.898335:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.898358:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616640 00000100:00100000:3.0:1789427895.898367:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616640 00000100:00100000:3.0:1789427895.898407:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1789427895.898437:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931616640:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789427895.902703:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789427895.902715:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789427895.902898:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931616640:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 4478us (4565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.902910:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789427895.905970:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.906075:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931616896 00000100:00100000:3.0:1789427895.906085:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931616896 00000100:00100000:3.0:1789427895.906153:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:3.0:1789427895.906171:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+14:11273:x1876350931616896:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.906223:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427895.906254:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51893d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c09 expref: 14 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.906272:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:3.0:1789427895.906277:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427895.906304:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.906318:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.906328:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427895.907991:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c582d99d reply state 000000006fec1ce4 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.908009:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.908017:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:2.0:1789427895.908019:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789427895.908032:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427895.908174:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+15:11273:x1876350931616896:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 2003us (2210us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789427895.908182:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:3.0:1789427895.913353:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427895.913583:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617024 00000100:00100000:2.0:1789427895.913593:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617024 00000100:00100000:2.0:1789427895.913839:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789427895.913850:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931617024:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789427895.914021:0:8400:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789427895.914025:0:8400:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789427895 -> 1789427893 00002000:00010000:2.0:1789427895.914028:0:8400:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789427892 00002000:00010000:2.0:1789427895.914030:0:8400:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789427895 -> 1789427893 00002000:00010000:2.0:1789427895.914032:0:8400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789427895.914889:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2395:x1876350931617024:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 1038us (1542us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789427895.914899:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1789427895.919006:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427895.919084:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617280 00000100:00100000:1.0:1789427895.919094:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617280 00000100:00100000:1.0:1789427895.919156:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:1.0:1789427895.919166:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+15:11273:x1876350931617280:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789427895.919233:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.919251:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.919261:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.919319:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.919342:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 15 pid: 6483 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.919356:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940078080:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427895.919463:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684c56300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427895.921561:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940078080:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427895.921587:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.928400:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427895.931844:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617408 00000100:00100000:1.0:1789427895.931861:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617408 00010000:00010000:1.0:1789427895.931914:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 16 pid: 6483 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.932020:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:1.0:1789427895.932041:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+16:2396:x1876350931617408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427895.932058:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427895.932065:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 16 pid: 6483 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932078:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 16 pid: 6483 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932102:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede51891a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300bfb expref: 16 pid: 6483 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932118:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:1.0:1789427895.932123:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932151:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932158:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.932275:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427895.932342:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+15:2396:x1876350931617408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 313us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.932350:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00010000:00010000:0.0:1789427895.937435:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937450:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937491:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937498:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937521:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937527:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427895.937531:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937538:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937555:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:0.0:1789427895.937558:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789427895.937562:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.937568:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518960 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427895.937732:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:11273:x1876350931617280:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 18563us (18730us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789427895.937741:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:0.0:1789427895.950003:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.952985:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617536 00000100:00100000:3.0:1789427895.952998:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617536 00000100:00100000:2.0:1789427895.953285:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789427895.953296:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931617536:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.953336:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.953355:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.953363:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427895.953368:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427895.953384:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.953434:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.953448:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 7 pid: 8401 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427895.953462:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1876350940078208:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427895.953593:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427895.956154:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8402:1876350940078208:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427895.956180:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427895.957909:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427895.958061:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617664 00000100:00100000:1.0:1789427895.958070:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617664 00010000:00010000:1.0:1789427895.958107:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 8 pid: 8401 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.958147:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:1.0:1789427895.958155:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931617664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427895.958168:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427895.958186:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 8 pid: 8401 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.958199:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 8 pid: 8401 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.958218:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede51894b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c17 expref: 8 pid: 8401 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.958249:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427895.958254:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427895.958259:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.958268:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.958300:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427895.958351:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931617664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 196us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.958358:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00010000:00010000:2.0:1789427895.958585:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958595:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958615:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958622:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958631:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958638:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427895.958649:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958658:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958669:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.958676:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e75e0a8/0x84fc867ede518967 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427895.958722:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931617536:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 5428us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.958730:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789427895.972711:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.972805:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931617920 00000100:00100000:3.0:1789427895.972815:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931617920 00000100:00100000:3.0:1789427895.972878:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:3.0:1789427895.972889:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+14:11273:x1876350931617920:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427895.973009:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.973026:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 14 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.973036:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.973068:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 14 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.973082:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 14 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.973096:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078336:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427895.973270:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427895.981602:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078336:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427895.981637:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427895.983285:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427895.983770:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618048 00000100:00100000:3.0:1789427895.983780:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618048 00010000:00010000:3.0:1789427895.983824:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427895.983870:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:3.0:1789427895.983880:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688832850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+15:2396:x1876350931618048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427895.983896:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427895.983903:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.983948:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.983970:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede5187ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ba0 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.984008:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427895.984014:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.984024:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.984094:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.984191:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427895.984251:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688832850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+14:2396:x1876350931618048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 372us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.984259:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00010000:00010000:0.0:1789427895.989608:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.989648:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.996198:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.996224:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 14 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.996235:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.996276:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 14 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.996294:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 14 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.996331:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078464:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427895.997525:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684c56300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.005185:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078464:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427896.005214:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.007148:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427896.007247:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618176 00000100:00100000:1.0:1789427896.007258:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618176 00010000:00010000:1.0:1789427896.007321:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.007367:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:1.0:1789427896.007378:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+15:2397:x1876350931618176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427896.007393:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427896.007399:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007411:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007586:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518928 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c02 expref: 15 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007604:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:1.0:1789427896.007609:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007617:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007626:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.007674:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427896.007725:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+14:2397:x1876350931618176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 348us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427896.007733:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00010000:00010000:0.0:1789427896.007863:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.007872:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427896.007991:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789427896.008112:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789427896.008150:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789427896.008223:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6484:1876350940078592:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789427896.008272:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427896.008303:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789427896.008398:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940078592 00000100:00100000:1.0:1789427896.008404:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940078592 00000100:00080000:2.0:1789427896.008902:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427896.009082:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789427896.009092:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6484:x1876350940078592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789427896.009203:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6484:x1876350940078592:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427896.009210:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789427896.009276:0:6484:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789427896.009282:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9196bfacca80, transno 4294967304 00000100:00100000:2.0:1789427896.009295:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6484:1876350940078592:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789427896.009501:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789427896.009545:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6484:1876350940078720:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789427896.009576:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427896.011703:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.011786:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940078720 00000100:00100000:3.0:1789427896.011795:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940078720 00000100:00100000:3.0:1789427896.011837:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789427896.011844:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6484:x1876350940078720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789427896.012129:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6484:1876350940078720:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789427896.012189:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012199:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012207:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012214:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427896.012219:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012227:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012241:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:2.0:1789427896.012244:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427896.012249:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012255:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518975 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012285:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012291:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012297:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012309:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427896.012312:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012318:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012326:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:2.0:1789427896.012329:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427896.012332:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012338:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede5188a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012383:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012398:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 17 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012407:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012469:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 17 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.012484:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 17 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.012507:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078848:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427896.012670:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698c8df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.015739:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6484:x1876350940078720:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (2454us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789427896.015759:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789427896.017077:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940078848:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427896.017107:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.017388:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427896.017501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618304 00000100:00100000:3.0:1789427896.017508:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618304 00010000:00010000:3.0:1789427896.017539:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 18 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.017565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:3.0:1789427896.017573:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:2397:x1876350931618304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427896.017588:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427896.017595:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 18 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017607:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 18 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017627:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede5188bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300be6 expref: 18 pid: 10064 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017641:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427896.017646:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017671:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017679:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017698:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427896.017743:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+17:2397:x1876350931618304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.017750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00010000:00010000:3.0:1789427896.017777:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017783:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017794:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017801:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017808:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017813:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427896.017817:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017824:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017840:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427896.017843:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427896.017847:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017853:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51897c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017862:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017868:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017873:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017878:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427896.017881:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017887:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017894:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:3.0:1789427896.017897:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427896.017899:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.017904:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51896e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427896.018097:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427896.018101:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427896.018114:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789427896.018121:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427896.018197:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+16:11273:x1876350931617920:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 45308us (45495us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789427896.018206:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00000020:00080000:3.0:1789427896.018210:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789427896.021896:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427896.022049:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618560 00000100:00100000:3.0:1789427896.022060:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618560 00000100:00100000:3.0:1789427896.022119:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789427896.022129:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+16:11273:x1876350931618560:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789427896.023343:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789427896.023379:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789427896.023627:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023645:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023659:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023668:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023674:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023680:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.023733:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789427896.023837:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:11273:x1876350931618560:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1707us (1947us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789427896.023845:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000020:00080000:2.0:1789427896.023850:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789427896.026674:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427896.026688:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.026699:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427896.026703:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.026713:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.026729:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:3.0:1789427896.026732:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789427896.026736:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.026764:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518983 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.027005:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427896.027008:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427896.027010:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427896.753575:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427897.137616:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940078976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427897.137674:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.137788:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940078976 00000100:00100000:3.0:1789427897.137794:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940078976 00000100:00100000:3.0:1789427897.137836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427897.137842:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940078976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427897.137868:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427897.137903:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940078976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.137907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789427897.138065:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940078976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427897.318525:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318570:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318596:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318626:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318649:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318834:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.318864:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427897.318952:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619072 00000100:00100000:1.0:1789427897.318974:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619072 00000100:00100000:1.0:1789427897.319056:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619200 00000100:00100000:1.0:1789427897.319061:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619200 00000100:00100000:1.0:1789427897.319088:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:1.0:1789427897.319098:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931619072:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427897.319190:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931619072:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.319198:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:1.0:1789427897.319221:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:1.0:1789427897.319240:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931619200:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427897.319270:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931619200:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.319276:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00080000:1.0:1789427897.319295:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427897.319300:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427897.321332:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618688 00000100:00100000:0.0:1789427897.321347:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618688 00000100:00100000:0.0:1789427897.321411:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 374 00000100:00100000:0.0:1789427897.321448:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931618688:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427897.321537:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931618688:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.321546:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 374 00000100:00100000:3.0:1789427897.328842:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618816 00000100:00100000:3.0:1789427897.328866:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618816 00000100:00100000:0.0:1789427897.328898:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619328 00000100:00100000:0.0:1789427897.328906:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619328 00000100:00100000:0.0:1789427897.329018:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931618944 00000100:00100000:0.0:1789427897.329022:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931618944 00000100:00100000:0.0:1789427897.329043:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619456 00000100:00100000:0.0:1789427897.329046:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619456 00000100:00100000:0.0:1789427897.329072:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 265 00000100:00100000:0.0:1789427897.329101:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931619328:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427897.329134:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 266 00000100:00100000:2.0:1789427897.329147:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931618944:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427897.329210:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 267 00000100:00100000:0.0:1789427897.329215:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931619328:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 116us (10616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.329223:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931619456:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427897.329230:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 265 00000100:00100000:0.0:1789427897.329255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 268 00000100:00100000:0.0:1789427897.329263:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931618816:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427897.333259:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931618944:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 4096us (14588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.333281:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 266 00000100:00100000:3.0:1789427897.334661:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931619456:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 5429us (15783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.334676:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 267 00000100:00100000:0.0:1789427897.335328:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931618816:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 6059us (16811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.335340:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 268 00000100:00080000:0.0:1789427897.335391:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427897.335398:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427897.648557:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427897.648599:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940079104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427897.648691:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.649490:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079104 00000100:00100000:1.0:1789427897.649502:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079104 00000100:00100000:1.0:1789427897.649602:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789427897.649615:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940079104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427897.649655:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427897.649776:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940079616:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.654834:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940079104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5082us (6002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.654855:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789427897.654901:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427897.654936:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940079360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655029:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655095:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940079872:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655118:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655139:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940080384:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655160:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655186:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789427897.655192:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940079488:0@lo:400:kworker.0 00000100:00100000:2.0:1789427897.655222:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079360 00000100:00100000:1.0:1789427897.655229:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427897.655234:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079360 00000100:00100000:1.0:1789427897.655254:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940080000:0@lo:400:kworker.0 00000100:00100000:2.0:1789427897.655284:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079872 00000100:00100000:2.0:1789427897.655288:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079872 00000100:00100000:2.0:1789427897.655318:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080384 00000100:00100000:2.0:1789427897.655321:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080384 00000100:00100000:2.0:1789427897.655337:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789427897.655342:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427897.655351:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940079360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655359:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940080512:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655385:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655440:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079488 00000100:00100000:1.0:1789427897.655444:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079488 00000100:00100000:1.0:1789427897.655475:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789427897.655481:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940079488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655526:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940079488:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.655533:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789427897.655555:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940079232:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655599:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.655613:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655631:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940079744:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.655643:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940080128:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655660:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427897.655684:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940080256:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.655685:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.655713:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940080640:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.655736:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.655757:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080128 00000100:00100000:3.0:1789427897.655761:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080128 00000100:00100000:3.0:1789427897.655789:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080640 00000100:00100000:3.0:1789427897.655800:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080640 00000100:00100000:3.0:1789427897.655849:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789427897.655856:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940080128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.655889:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.656345:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940080128:12345-0@lo:400:kworker.0 Request processed in 488us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.656354:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789427897.656376:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080256 00000100:00100000:3.0:1789427897.656381:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080256 00000100:00100000:1.0:1789427897.656383:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940080768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427897.656434:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789427897.656445:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940080640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.656460:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427897.656526:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940079360:12345-0@lo:400:kworker.0 Request processed in 1177us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.656543:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940080640:12345-0@lo:400:kworker.0 Request processed in 97us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.656551:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789427897.656554:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940079104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427897.656575:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789427897.656585:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940080256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.656674:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079744 00000100:00100000:1.0:1789427897.656680:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079744 00000100:00100000:3.0:1789427897.656689:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940080256:12345-0@lo:400:kworker.0 Request processed in 104us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.656697:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789427897.656736:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940080256:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.656762:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940080640:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.656784:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940080128:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.656826:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427897.656836:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940079744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427897.656883:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789427897.656909:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080000 00000100:00100000:2.0:1789427897.656913:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080000 00000100:00100000:2.0:1789427897.656932:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080512 00000100:00100000:2.0:1789427897.656935:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080512 00000100:00100000:2.0:1789427897.656949:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079616 00000100:00100000:2.0:1789427897.656952:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079616 00000100:00100000:2.0:1789427897.656985:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789427897.656995:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789427897.656996:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940079872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657009:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940080384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427897.657040:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940079872:12345-0@lo:400:kworker.0 Request processed in 47us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.657048:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789427897.657055:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940080384:12345-0@lo:400:kworker.0 Request processed in 50us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.657077:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940079744:12345-0@lo:400:kworker.0 Request processed in 242us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.657086:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427897.657123:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940079488:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.657136:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940079360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.657148:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940079872:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.657159:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940080384:0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.657183:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940080768 00000100:00100000:1.0:1789427897.657187:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940080768 00000100:00100000:1.0:1789427897.657215:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789427897.657222:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940080768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427897.657237:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427897.657272:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940080768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.657279:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789427897.657456:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789427897.657464:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789427897.657469:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940080000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657491:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789427897.657500:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940080512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427897.657520:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940080000:12345-0@lo:400:kworker.0 Request processed in 55us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.657529:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789427897.657547:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940080512:12345-0@lo:400:kworker.0 Request processed in 45us (2157us total) trans 0 rc 0/0 00010000:00080000:1.0:1789427897.657548:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958444ce00 x1876350940080000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427897.657560:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789427897.657570:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940080000:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657580:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789427897.657588:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940079616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657623:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940079616:12345-0@lo:400:kworker.0 Request processed in 37us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.657630:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:1.0:1789427897.657646:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958444fb80 x1876350940080512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427897.657659:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940080512:0@lo:400:kworker.0 00000100:00080000:3.0:1789427897.657661:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427897.657668:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427897.657671:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427897.657675:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427897.657698:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940079744:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657712:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940080768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427897.657735:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940079616:0@lo:400:kworker.0 00000100:00100000:3.0:1789427897.657779:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940079232 00000100:00100000:3.0:1789427897.657784:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940079232 00000100:00100000:1.0:1789427897.657840:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789427897.657850:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940079232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427897.657897:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940079232:12345-0@lo:400:kworker.0 Request processed in 50us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.657904:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789427897.657992:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940079232:0@lo:400:kworker.0 00000040:00080000:3.0:1789427897.696944:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427897.696953:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427897.696986:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789427897.696992:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789427897.777566:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427897.857268:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.857327:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619712 00000100:00100000:2.0:1789427897.857340:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619712 00000100:00100000:2.0:1789427897.865607:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:2.0:1789427897.865633:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:11292:x1876350931619712:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427897.865664:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427897.865693:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51898a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c1e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.865844:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518991 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.865874:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518991 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.865889:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518991 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427897.865905:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789427897.866061:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51898a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c1e expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.866082:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c1e expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.866094:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427897.866097:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427897.866102:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429e00, rc 0) 00000100:00100000:2.0:1789427897.866196:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:11292:x1876350931619712:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 573us (8942us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789427897.866206:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:0.0:1789427897.870400:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.870489:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931619840 00000100:00100000:3.0:1789427897.870506:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931619840 00000100:00100000:3.0:1789427897.870582:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:3.0:1789427897.870595:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+20:11292:x1876350931619840:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1789427897.870699:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870723:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870739:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870760:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870768:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870776:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870885:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870894:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.870902:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427897.870979:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871012:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871020:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871028:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871036:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.871040:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871049:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871064:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427897.871068:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427897.871074:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871082:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede51899f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871095:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871102:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871108:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871123:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.871126:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871133:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871142:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862300) 00010000:00010000:3.0:1789427897.871144:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427897.871148:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871154:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871170:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871177:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871183:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871188:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.871191:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871198:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871216:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862000) 00010000:00010000:3.0:1789427897.871218:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427897.871222:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.871229:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.871625:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+20:11292:x1876350931619840:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1030us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.871634:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:2.0:1789427897.913255:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.913622:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620096 00000100:00100000:3.0:1789427897.913637:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620096 00000100:00100000:3.0:1789427897.913714:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:3.0:1789427897.913727:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+20:11295:x1876350931620096:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427897.913762:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427897.913795:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c25 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.913889:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.913992:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914007:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914031:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914062:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914070:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914209:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914218:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914225:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427897.914237:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789427897.914572:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914581:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914588:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914594:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.914599:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914608:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914633:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427897.914637:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427897.914644:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914651:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914667:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914674:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914681:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914686:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.914690:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914753:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914762:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862000) 00010000:00010000:3.0:1789427897.914765:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427897.914768:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914774:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914833:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 23 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914851:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 22 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.914858:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427897.914860:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427897.914863:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a800, rc 0) 00000100:00100000:3.0:1789427897.914949:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+22:11295:x1876350931620096:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1224us (1710us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789427897.914970:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:0.0:1789427897.920893:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427897.923777:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620224 00000100:00100000:2.0:1789427897.923803:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620224 00000100:00100000:3.0:1789427897.930928:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:3.0:1789427897.930952:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:11295:x1876350931620224:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1789427897.931077:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931102:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931131:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931182:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931190:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931218:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931225:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427897.931230:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931239:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931253:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427897.931257:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427897.931264:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.931270:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.931386:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:11295:x1876350931620224:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 442us (10512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.931406:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:0.0:1789427897.938069:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.938223:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620480 00000100:00100000:3.0:1789427897.938237:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620480 00000100:00100000:3.0:1789427897.938315:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789427897.938329:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+22:11295:x1876350931620480:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1789427897.938757:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+23:11295:x1876350931620480:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 430us (703us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789427897.938766:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1789427897.987989:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.988184:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620736 00000100:00100000:3.0:1789427897.988199:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620736 00000100:00100000:3.0:1789427897.988276:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:3.0:1789427897.988289:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+23:10813:x1876350931620736:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427897.988320:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427897.988348:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c2c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.988609:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.988628:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 24 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.988639:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.988684:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 24 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.988699:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 24 pid: 10064 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.988714:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940080896:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427897.989479:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427897.991758:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940080896:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427897.991916:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.992032:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.992121:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620864 00000100:00100000:3.0:1789427897.992131:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620864 00010000:00010000:3.0:1789427897.992244:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 25 pid: 10064 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.992289:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:3.0:1789427897.992301:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+25:2396:x1876350931620864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427897.992321:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427897.992329:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 25 pid: 10064 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992343:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 25 pid: 10064 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992371:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede5189c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c25 expref: 25 pid: 10064 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992406:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427897.992412:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992600:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992611:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.992647:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427897.992731:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+24:2396:x1876350931620864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 431us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.992740:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00010000:00010000:2.0:1789427897.992936:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.992947:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427897.992984:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789427897.993228:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede5189de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.993249:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.993258:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:2.0:1789427897.993261:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427897.993264:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a200, rc 0) 00000100:00100000:2.0:1789427897.993311:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+24:10813:x1876350931620736:12345-192.168.202.24@tcp:101:bash.0 Request processed in 5025us (5337us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789427897.993319:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:1.0:1789427897.995275:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427897.995362:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931620992 00000100:00100000:3.0:1789427897.995372:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931620992 00000100:00100000:3.0:1789427897.995553:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:3.0:1789427897.995565:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+24:10813:x1876350931620992:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427897.995595:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427897.995617:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c33 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995653:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5189fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995665:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5189fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995674:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5189fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995802:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a400/0x84fc867ede5189f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c33 expref: 26 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995817:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5189fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c33 expref: 25 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.995824:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427897.995826:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427897.995828:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883b400, rc 0) 00000100:00100000:3.0:1789427897.996066:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+25:10813:x1876350931620992:12345-192.168.202.24@tcp:101:bash.0 Request processed in 502us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.996075:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:0.0:1789427898.000380:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.000859:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931621248 00000100:00100000:3.0:1789427898.000872:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931621248 00000100:00100000:3.0:1789427898.000980:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:3.0:1789427898.000994:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+25:10813:x1876350931621248:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:3.0:1789427898.001335:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.001358:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.001373:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427898.001477:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789427898.001506:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003958929f reply state 00000000a1aa39ec transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.001522:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.001531:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.001535:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427898.001541:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789427898.001651:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00080000:1.0:1789427898.002069:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427898.003025:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+29:10813:x1876350931621248:12345-192.168.202.24@tcp:36:bash.0 Request processed in 2014us (2639us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789427898.003040:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000020:00080000:2.0:1789427898.003049:0:8108:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789427898.006732:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.006840:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931621376 00000100:00100000:2.0:1789427898.006853:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931621376 00000100:00100000:2.0:1789427898.006978:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:2.0:1789427898.006992:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+29:10813:x1876350931621376:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427898.007028:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.007056:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518a08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c3a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.007140:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c3a expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.007159:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c3a expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.007194:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:2.0:1789427898.007198:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427898.007202:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789427898.007362:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+30:10813:x1876350931621376:12345-192.168.202.24@tcp:101:bash.0 Request processed in 371us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.007370:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:1.0:1789427898.012043:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.012169:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931621504 00000100:00100000:3.0:1789427898.012192:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931621504 00000100:00100000:3.0:1789427898.012306:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:3.0:1789427898.012320:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+6:10813:x1876350931621504:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427898.012364:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.012402:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c41 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427898.012539:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa880b5, atime: 0x6aa880b4, ctime: 0x6aa880b5, blocks: 0x8 00010000:00010000:3.0:1789427898.012572:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=242s v=(0 0) 00010000:00010000:3.0:1789427898.012578:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.012588:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.012612:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.012628:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a400, rc 0) 00000100:00100000:3.0:1789427898.012699:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:10813:x1876350931621504:12345-192.168.202.24@tcp:101:bash.0 Request processed in 382us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.012707:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:0.0:1789427898.018363:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.018541:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931621632 00000100:00100000:1.0:1789427898.018555:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931621632 00002000:00010000:1.0:1789427898.018610:0:8405:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1789427898.018616:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8c000 with x1876350931621632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789427898.018632:0:8405:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfb8c000. 00000100:00100000:1.0:1789427898.018672:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1789427898.018683:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931621632:12345-192.168.202.24@tcp:10:bash.0 00002000:00010000:1.0:1789427898.019149:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789427898.019154:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789427893 -> 1789427897 00002000:00010000:1.0:1789427898.019157:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789427892 -> 1789427892 00002000:00010000:1.0:1789427898.019159:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789427893 -> 1789427897 00002000:00010000:1.0:1789427898.019161:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789427898.019670:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931621632:12345-192.168.202.24@tcp:10:bash.0 Request processed in 984us (1318us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789427898.019681:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00002000:00010000:1.0:1789427898.019687:0:8405:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1789427898.019691:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8c000 with x1876350931621632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789427898.019698:0:8405:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfb8c000. 00000100:00100000:0.0:1789427898.066976:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.067134:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931621760 00000100:00100000:3.0:1789427898.067355:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931621760 00000100:00100000:3.0:1789427898.067498:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:3.0:1789427898.067515:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+30:11309:x1876350931621760:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1789427898.067613:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067631:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067662:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067676:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067681:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067687:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067791:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067799:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067804:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427898.067861:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067874:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067882:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.067978:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068000:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.068005:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068014:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068028:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.068030:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.068035:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068040:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068052:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068056:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068060:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068063:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ba00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.068065:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068068:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068080:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:3.0:1789427898.068081:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.068083:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068088:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068099:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068103:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068106:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068109:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.068111:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068114:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068117:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.068119:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.068120:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.068123:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.068395:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+30:11309:x1876350931621760:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 878us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.068404:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:2.0:1789427898.110644:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.110836:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931622016 00000100:00100000:3.0:1789427898.110851:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931622016 00000100:00100000:3.0:1789427898.110978:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:3.0:1789427898.110991:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+30:11312:x1876350931622016:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427898.111034:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.111063:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c48 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111175:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111195:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111212:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111231:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111239:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111245:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111471:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518a40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111482:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111490:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427898.111502:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789427898.111609:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111617:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111624:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111630:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ba00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.111636:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111644:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111657:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.111660:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.111665:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111682:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111715:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111723:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111729:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111734:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.111737:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111744:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111752:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:3.0:1789427898.111755:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.111758:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111765:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111818:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c48 expref: 33 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111833:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c48 expref: 32 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.111847:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.111850:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789427898.111853:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964400, rc 0) 00000100:00100000:3.0:1789427898.111930:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+32:11312:x1876350931622016:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 941us (1299us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789427898.111937:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:0.0:1789427898.124158:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.124300:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931622144 00000100:00100000:2.0:1789427898.124313:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931622144 00000100:00100000:2.0:1789427898.124396:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:2.0:1789427898.124409:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+32:11312:x1876350931622144:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1789427898.124559:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.124583:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.124595:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.124641:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.124659:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 32 pid: 6484 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.124677:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940081024:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.124833:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698c8d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.203893:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.204778:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931622400 00000100:00100000:3.0:1789427898.204794:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931622400 00000100:00100000:3.0:1789427898.204952:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1789427898.204978:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+33:6153:x1876350931622400:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789427898.205532:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+34:6153:x1876350931622400:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 554us (1650us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789427898.205643:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789427898.205846:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940081024:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.205884:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.207635:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.207809:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931622528 00000100:00100000:3.0:1789427898.207822:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931622528 00010000:00010000:3.0:1789427898.207871:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 34 pid: 6484 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.207927:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:3.0:1789427898.207938:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+34:2396:x1876350931622528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.207969:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.207978:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 34 pid: 6484 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.207994:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 34 pid: 6484 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.208052:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede5189e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c2c expref: 34 pid: 6484 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.208074:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.208080:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.208092:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.208101:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.208139:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.208207:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+33:2396:x1876350931622528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 271us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.208215:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00010000:00010000:2.0:1789427898.208814:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208827:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208883:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208892:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208899:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208906:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.208911:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208920:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208934:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:2.0:1789427898.208938:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427898.208942:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.208991:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.209074:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+32:11312:x1876350931622144:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 84665us (85124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.209084:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:1.0:1789427898.224848:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427898.225122:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931622784 00000100:00100000:0.0:1789427898.225136:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931622784 00000100:00100000:0.0:1789427898.225214:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789427898.225226:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+32:11312:x1876350931622784:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427898.225571:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+33:11312:x1876350931622784:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 347us (736us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789427898.225597:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789427898.366210:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.366624:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931623040 00000100:00100000:3.0:1789427898.366639:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931623040 00000100:00100000:2.0:1789427898.366839:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 105 00000100:00100000:2.0:1789427898.366854:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+33:11323:x1876350931623040:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:2.0:1789427898.367096:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.367126:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c4f expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367228:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367246:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367261:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367359:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367369:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367377:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367576:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518a6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367587:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518a6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367594:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518a6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.367606:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789427898.367707:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367716:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367723:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367730:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.367736:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367744:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367759:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427898.367762:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.367830:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367850:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518a5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367867:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367874:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367880:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367949:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.367964:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367971:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367980:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919698406d00) 00010000:00010000:2.0:1789427898.367983:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.367986:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.367993:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518a63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.368110:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518a55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c4f expref: 36 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.368139:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518a6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c4f expref: 35 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.368147:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:2.0:1789427898.368150:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427898.368153:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427898.368384:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+35:11323:x1876350931623040:12345-192.168.202.24@tcp:101:cat.0 Request processed in 1531us (2189us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789427898.368394:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 105 00000100:00100000:1.0:1789427898.379743:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427898.383501:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931623296 00000100:00100000:0.0:1789427898.383524:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931623296 00000100:00100000:0.0:1789427898.383668:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1789427898.383682:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+35:11323:x1876350931623296:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1789427898.384499:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+36:11323:x1876350931623296:12345-192.168.202.24@tcp:35:cat.0 Request processed in 817us (4769us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789427898.384509:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:1.0:1789427898.402926:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.403359:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931623552 00000100:00100000:3.0:1789427898.403375:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931623552 00000100:00100000:3.0:1789427898.403644:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:3.0:1789427898.403657:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+36:11324:x1876350931623552:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1789427898.403738:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789427898.403783:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518a08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c3a expref: 36 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403811:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518a6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c4f expref: 35 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403844:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518a40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c48 expref: 34 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403861:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede5189fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c33 expref: 33 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403872:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.403879:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427898.403918:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403935:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403946:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403973:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403981:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.403988:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404098:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404108:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404122:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427898.404599:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789427898.404612:0:8108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242899196154ns, next at 243899192848ns, rc = 0 00010000:00010000:3.0:1789427898.404666:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404676:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404685:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404693:0:8108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404700:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404707:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404730:0:8108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427898.404751:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404759:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404766:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404779:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.404784:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404794:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404805:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:3.0:1789427898.404808:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789427898.404813:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404819:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a86 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404836:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404842:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404848:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404854:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.404857:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.404862:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.405003:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.405008:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.405013:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.405021:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427898.405032:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000803b4633 reply state 000000004d0e50af transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.405053:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.405060:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:3.0:1789427898.405069:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427898.405073:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789427898.405398:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427898.405406:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.405430:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ba00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427898.405434:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.405441:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.405451:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:0.0:1789427898.405454:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427898.405457:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.405463:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518a8d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.405476:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427898.405485:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427898.405487:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427898.405626:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+34:11324:x1876350931623552:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1968us (2711us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789427898.405636:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:2.0:1789427898.444122:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.444410:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931623808 00000100:00100000:3.0:1789427898.444471:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931623808 00000100:00100000:3.0:1789427898.444547:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:3.0:1789427898.444560:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+34:11330:x1876350931623808:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427898.444591:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.444617:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c56 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444747:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444766:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444796:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444809:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444816:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.444823:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427898.445237:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789427898.445400:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445409:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445444:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445481:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445490:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445498:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445505:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.445519:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445528:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445543:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.445547:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.445553:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445560:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518a9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427898.445577:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000054bf813a reply state 00000000c57388e5 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445590:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445597:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:3.0:1789427898.445600:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427898.445603:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789427898.445633:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518a94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 37 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445648:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 36 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.445657:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427898.445660:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427898.445667:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ba00, rc 0) 00000100:00100000:3.0:1789427898.447154:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+37:11330:x1876350931623808:12345-192.168.202.24@tcp:101:bash.0 Request processed in 2588us (3037us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789427898.447169:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1789427898.453357:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.453458:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931623936 00000100:00100000:3.0:1789427898.453471:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931623936 00000100:00100000:3.0:1789427898.453549:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1789427898.453561:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931623936:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427898.453585:0:8902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.453612:0:8902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c5d expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427898.453647:0:8902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789427898.453673:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=242s v=(0 0) 00010000:00010000:3.0:1789427898.453678:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.453689:0:8902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 8 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.453711:0:8902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 8 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.453727:0:8902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a200, rc 0) 00000100:00100000:3.0:1789427898.453791:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931623936:12345-192.168.202.24@tcp:101:bash.0 Request processed in 233us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.453797:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1789427898.456624:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.456937:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624064 00000100:00100000:3.0:1789427898.456949:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624064 00000100:00100000:3.0:1789427898.457050:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1789427898.457063:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+8:11330:x1876350931624064:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427898.457088:0:13777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.457111:0:13777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c64 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.457154:0:13777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 9 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.457166:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.457171:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.457177:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 9 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.457224:0:13777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 9 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.457241:0:13777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 9 pid: 8902 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.457259:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940081152:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.460473:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.463785:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.464396:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624192 00000100:00100000:3.0:1789427898.464409:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624192 00010000:00010000:3.0:1789427898.464485:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 10 pid: 8902 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.464569:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1789427898.464581:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931624192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.464601:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.464630:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 10 pid: 8902 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.464644:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 10 pid: 8902 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.464675:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.464680:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.464691:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 10 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.464702:0:7887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 10 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.464749:0:7887:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 10 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.464766:0:7887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7887:1876350940081280:192.168.202.24@tcp:105: 00000100:00100000:3.0:1789427898.464873:0:7887:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427898.468849:0:7887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7887:1876350940081280:192.168.202.24@tcp:105: 00010000:00010000:3.0:1789427898.469091:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.469169:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931624192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4589us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.469183:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00010000:00010000:2.0:1789427898.470712:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518ab7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c5d expref: 9 pid: 8902 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.470739:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940081152:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.470772:0:13777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 8 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.470789:0:13777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a800, rc 0) 00000100:00100000:2.0:1789427898.470983:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+8:11330:x1876350931624064:12345-192.168.202.24@tcp:101:bash.0 Request processed in 13895us (14342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.470992:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1789427898.474068:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.474167:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624448 00000100:00100000:3.0:1789427898.474180:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624448 00000100:00100000:3.0:1789427898.474295:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789427898.474308:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+37:11330:x1876350931624448:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:3.0:1789427898.474732:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+38:11330:x1876350931624448:12345-192.168.202.24@tcp:35:bash.0 Request processed in 426us (735us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789427898.474741:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1789427898.594092:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.594215:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624576 00000100:00100000:2.0:1789427898.594229:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624576 00000100:00100000:2.0:1789427898.594324:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:2.0:1789427898.594335:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+38:11346:x1876350931624576:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427898.594364:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.594399:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c6b expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594518:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594536:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594553:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.594606:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789427898.594610:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427898.594634:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594665:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c6b expref: 40 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594685:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c6b expref: 39 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.594695:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427898.594698:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427898.594702:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427898.594764:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+39:11346:x1876350931624576:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 431us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.594779:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:2.0:1789427898.599912:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.600129:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624832 00000100:00100000:1.0:1789427898.600142:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624832 00000100:00100000:1.0:1789427898.600228:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:1.0:1789427898.600239:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+39:11346:x1876350931624832:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427898.600269:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427898.600300:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518ad3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c72 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.600490:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ada lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.600508:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.600523:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427898.600537:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789427898.600676:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518ad3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c72 expref: 42 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.600721:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c72 expref: 41 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.600732:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:1.0:1789427898.600736:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427898.600741:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46c00, rc 0) 00000100:00100000:1.0:1789427898.600811:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+41:11346:x1876350931624832:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 573us (913us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789427898.600820:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:0.0:1789427898.607712:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.608086:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.608173:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625216 00000100:00100000:3.0:1789427898.608185:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625216 00000100:00100000:3.0:1789427898.608278:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:3.0:1789427898.608287:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+41:11346:x1876350931625216:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:1.0:1789427898.608377:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931624960 00000100:00100000:1.0:1789427898.608384:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931624960 00000100:00100000:1.0:1789427898.608535:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789427898.608543:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+42:2396:x1876350931624960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427898.608561:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427898.608592:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c72 expref: 42 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.608616:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:1.0:1789427898.608622:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427898.608695:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+41:2396:x1876350931624960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 152us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427898.608705:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00010000:00010000:3.0:1789427898.611576:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.611619:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518ae8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c79 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.611786:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.611804:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.611819:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427898.611841:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789427898.611987:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518ae8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c79 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.612010:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c79 expref: 42 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.612019:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427898.612022:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789427898.612027:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964400, rc 0) 00000100:00100000:3.0:1789427898.612215:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+42:11346:x1876350931625216:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 3926us (4128us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789427898.612226:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:2.0:1789427898.619919:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.620014:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625344 00000100:00100000:3.0:1789427898.620027:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625344 00000100:00100000:3.0:1789427898.620101:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:3.0:1789427898.620124:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2394:x1876350931625344:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:3.0:1789427898.620186:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.620211:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 8 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.620221:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789427898.620226:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427898.620231:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.620291:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 8 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.620476:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 8 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.620496:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8401:1876350940081408:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427898.620739:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.624865:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.624999:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8401:1876350940081408:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427898.625032:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.625121:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625472 00000100:00100000:1.0:1789427898.625131:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625472 00002000:00100000:1.0:1789427898.625191:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9196bfb8ce00 x1876350931625472/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:144/0 lens 504/0 e 0 to 0 dl 1789427909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427898.625217:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8ce00 with x1876350931625472 ext(0->8) 00010000:00010000:1.0:1789427898.625227:0:8407:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 9 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.625243:0:8407:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 9 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427898.625250:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9196bfb8ce00 00000100:00100000:1.0:1789427898.625351:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1789427898.625361:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931625472:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:1.0:1789427898.627772:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931625472:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 2401us (2911us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789427898.627885:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00002000:00100000:1.0:1789427898.627901:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9196bfb8ce00 x1876350931625472/t4294967303(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:144/0 lens 504/448 e 0 to 0 dl 1789427909 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427898.627912:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8ce00 with x1876350931625472 ext(0->8) 00010000:00010000:1.0:1789427898.627923:0:8407:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 11 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.627946:0:8407:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 11 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427898.628938:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9196bfb8ce00 00000100:00100000:0.0:1789427898.630708:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.630768:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625600 00000100:00100000:3.0:1789427898.630782:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625600 00010000:00010000:3.0:1789427898.630836:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 11 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427898.630869:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789427898.630886:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789427898.631262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:3.0:1789427898.631276:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688832c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931625600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.631294:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789427898.631315:0:6513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789427898.631319:0:6513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789427898 00002000:00010000:3.0:1789427898.631322:0:6513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789427898 00002000:00010000:3.0:1789427898.631324:0:6513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789427898 00002000:00010000:3.0:1789427898.631342:0:6513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789427898.631351:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 7 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.631368:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 7 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.631398:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae70b47/0x84fc867ede518abe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c64 expref: 7 pid: 13777 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.631461:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427898.631467:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427898.631474:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.631486:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.631516:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.631587:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688832c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931625600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 314us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.631596:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00010000:00010000:0.0:1789427898.631596:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631611:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631636:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631646:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631656:0:8401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631665:0:8401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427898.631671:0:8401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631695:0:8401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631711:0:8401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.631720:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038126881/0x84fc867ede518afd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.631786:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931625344:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 11665us (11879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.631798:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789427898.633340:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.633489:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625856 00000100:00100000:2.0:1789427898.633501:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625856 00000100:00100000:2.0:1789427898.633566:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:2.0:1789427898.633577:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+42:11346:x1876350931625856:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:2.0:1789427898.633652:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c79 expref: 42 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427898.633935:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789427898.633987:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789427898.634695:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789427898.634742:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.634760:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.634770:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.634814:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.634841:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 46 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.634853:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940081536:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.634933:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427898.638135:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940081536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.638179:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.641065:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.641207:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931625984 00000100:00100000:3.0:1789427898.641220:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931625984 00010000:00010000:3.0:1789427898.641271:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 47 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.641319:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:3.0:1789427898.641342:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+47:2396:x1876350931625984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.641358:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.641364:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 47 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641375:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 47 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641396:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518aa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c56 expref: 47 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641412:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427898.641445:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641453:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641459:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.641483:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.641538:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+46:2396:x1876350931625984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 197us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.641543:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00010000:00010000:0.0:1789427898.641610:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.641620:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427898.641751:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789427898.641868:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789427898.641964:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940081664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427898.642025:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427898.642061:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427898.642747:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940081664 00000100:00100000:3.0:1789427898.642756:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940081664 00000100:00100000:3.0:1789427898.642833:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789427898.642840:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940081664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789427898.642948:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940081664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.642962:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789427898.643026:0:6486:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1789427898.643033:0:6486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1789427898.643056:0:6486:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9196bfaced80, transno 4294967302 00000100:00100000:2.0:1789427898.643070:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940081664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789427898.643221:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789427898.643276:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940081792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789427898.643330:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427898.643496:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.643881:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940081792 00000100:00100000:0.0:1789427898.643895:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940081792 00000100:00100000:0.0:1789427898.643923:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789427898.643929:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940081792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427898.644070:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6486:x1876350940081792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (740us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789427898.644079:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789427898.644159:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940081792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789427898.644203:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789427898.644240:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644252:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644260:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644273:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.644279:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644289:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644315:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:2.0:1789427898.644319:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789427898.644325:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.644331:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427898.644468:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789427898.644529:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789427898.644539:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 243139123585ns, next at 244139121698ns, rc = 0 00000001:00080000:2.0:1789427898.644544:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789427898.644560:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862100) 00010000:00010000:2.0:1789427898.644562:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789427898.644567:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518aef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c79 expref: 50 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.644664:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+49:11346:x1876350931625856:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 11090us (11331us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789427898.644671:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000020:00080000:2.0:1789427898.644673:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789427898.649496:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.649671:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931626112 00000100:00100000:3.0:1789427898.649688:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931626112 00000100:00100000:3.0:1789427898.649767:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:3.0:1789427898.649791:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+49:11346:x1876350931626112:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427898.649823:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.649852:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518b0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c80 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.649924:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518b0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c80 expref: 50 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.649940:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518b0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c80 expref: 50 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.649979:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.649982:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427898.649986:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208800, rc 0) 00000100:00100000:3.0:1789427898.650059:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+50:11346:x1876350931626112:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 273us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.650066:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:3.0:1789427898.656261:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.657535:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931626368 00000100:00100000:1.0:1789427898.657581:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931626368 00000100:00100000:1.0:1789427898.657658:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1789427898.657670:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+50:11346:x1876350931626368:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789427898.657924:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+51:11346:x1876350931626368:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 256us (1674us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789427898.657932:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1789427898.678061:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940081920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427898.678137:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427898.678224:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427898.678231:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940082048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427898.678255:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427898.678337:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940081920 00000100:00100000:0.0:1789427898.678346:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940081920 00000100:00100000:0.0:1789427898.678409:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940082048 00000100:00100000:0.0:1789427898.678437:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940082048 00000100:00100000:0.0:1789427898.678457:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789427898.678467:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940081920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427898.678495:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427898.678540:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940081920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.678547:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789427898.678563:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789427898.678570:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940082048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427898.678580:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427898.678605:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940082048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.678610:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789427898.679820:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940082048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427898.679837:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940081920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427898.741984:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.742139:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931626496 00000100:00100000:2.0:1789427898.742156:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931626496 00000100:00100000:2.0:1789427898.742244:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:2.0:1789427898.742254:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+51:11356:x1876350931626496:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:2.0:1789427898.742326:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742342:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742353:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742363:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742369:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742529:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742606:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742616:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742623:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427898.742670:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742696:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742702:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742709:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742714:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.742718:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742725:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742736:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427898.742739:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.742743:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742749:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742759:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742764:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742769:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742779:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.742782:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742787:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742793:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:2.0:1789427898.742795:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.742798:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742803:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742810:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742816:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742820:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742825:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.742827:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742833:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742848:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.742850:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.742853:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.742858:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.742933:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+51:11356:x1876350931626496:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 679us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.742940:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:0.0:1789427898.779834:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.780070:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931626752 00000100:00100000:3.0:1789427898.780083:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931626752 00000100:00100000:3.0:1789427898.780174:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:3.0:1789427898.780205:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+51:11359:x1876350931626752:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427898.780232:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.780260:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518b27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c87 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780355:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780374:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780388:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780402:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780410:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780471:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780612:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780621:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.780629:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427898.780650:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789427898.781005:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781015:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781023:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781029:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.781034:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781042:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781055:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.781059:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.781064:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781072:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518b2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781089:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781095:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781112:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781118:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.781121:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781129:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781137:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:3.0:1789427898.781150:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427898.781154:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781161:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781203:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518b27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781219:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 53 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.781226:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.781228:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427898.781231:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883ba00, rc 0) 00000100:00100000:3.0:1789427898.781518:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+53:11359:x1876350931626752:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1316us (1697us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789427898.781539:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:0.0:1789427898.785665:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.785861:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931626880 00000100:00100000:3.0:1789427898.785874:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931626880 00000100:00100000:3.0:1789427898.786073:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:3.0:1789427898.786087:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+53:11359:x1876350931626880:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1789427898.786840:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786861:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786875:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786921:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786930:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786938:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786945:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427898.786962:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786971:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.786985:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.787068:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427898.787076:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.787084:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.787180:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+53:11359:x1876350931626880:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 1095us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.787190:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:0.0:1789427898.789872:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.789989:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931627136 00000100:00100000:1.0:1789427898.789999:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931627136 00000100:00100000:1.0:1789427898.790049:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:1.0:1789427898.790057:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+53:11359:x1876350931627136:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789427898.790273:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+54:11359:x1876350931627136:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 217us (413us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789427898.790279:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00010000:00010000:2.0:1789427898.806208:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427898.882678:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.883059:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931627392 00000100:00100000:2.0:1789427898.883072:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931627392 00000100:00100000:2.0:1789427898.883151:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:2.0:1789427898.883163:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+54:11369:x1876350931627392:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427898.883196:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.883200:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789427898.883233:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518acc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c6b expref: 54 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883259:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427898.883265:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427898.883281:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c8e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883475:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883498:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883508:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883549:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.883563:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 54 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.883579:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082176:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.883704:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427898.885749:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082176:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.885882:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.886356:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.886483:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931627520 00000100:00100000:1.0:1789427898.886492:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931627520 00010000:00010000:1.0:1789427898.886537:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 55 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.886632:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:1.0:1789427898.886643:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+55:2397:x1876350931627520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427898.886661:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427898.886678:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 55 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886690:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 55 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886714:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ba00/0x84fc867ede518b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c87 expref: 55 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886731:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:1.0:1789427898.886736:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886746:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886754:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.886795:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427898.886852:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+54:2397:x1876350931627520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 211us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427898.886860:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00010000:00010000:2.0:1789427898.886912:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.886920:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.886940:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789427898.887120:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518b51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 55 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.887161:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 54 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.887170:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.887173:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427898.887175:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789427898.887201:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+54:11369:x1876350931627392:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4041us (4545us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789427898.887208:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:3.0:1789427898.889631:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.889709:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931627648 00000100:00100000:3.0:1789427898.889721:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931627648 00000100:00100000:3.0:1789427898.889795:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:3.0:1789427898.889807:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+54:11369:x1876350931627648:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427898.889839:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.889997:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518b66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c95 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890063:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890091:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890106:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890259:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a800/0x84fc867ede518b66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 56 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890291:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 55 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.890301:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.890304:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427898.890308:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91968883a200, rc 0) 00000100:00100000:3.0:1789427898.890376:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+55:11369:x1876350931627648:12345-192.168.202.24@tcp:101:bash.0 Request processed in 570us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.890384:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:3.0:1789427898.894474:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.894633:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931627904 00000100:00100000:2.0:1789427898.894647:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931627904 00000100:00100000:2.0:1789427898.894726:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:2.0:1789427898.894740:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+55:11369:x1876350931627904:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:2.0:1789427898.895654:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.895679:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.895694:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427898.895753:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789427898.895781:0:6483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001f3f1932 reply state 00000000e598f2e3 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.895793:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.895820:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.895823:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789427898.895829:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427898.896220:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+58:11369:x1876350931627904:12345-192.168.202.24@tcp:36:bash.0 Request processed in 1480us (1804us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789427898.896231:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000020:00080000:2.0:1789427898.896238:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789427898.900893:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.901239:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628032 00000100:00100000:2.0:1789427898.901253:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628032 00000100:00100000:2.0:1789427898.901360:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:2.0:1789427898.901373:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+58:11369:x1876350931628032:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427898.901408:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.901475:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300c9c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.901697:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.901717:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 59 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.901728:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.901777:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 59 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.901794:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 59 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.901828:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082304:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.901974:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427898.904766:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427898.904842:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628160 00000100:00100000:0.0:1789427898.904853:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628160 00010000:00010000:0.0:1789427898.904906:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 60 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.904991:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:0.0:1789427898.905017:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:2396:x1876350931628160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427898.905036:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427898.905045:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 60 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.905061:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 60 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.905098:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:0.0:1789427898.905105:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.905116:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.905125:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.905147:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427898.905208:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:2396:x1876350931628160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 197us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.905216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00010000:00010000:2.0:1789427898.905941:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c8e expref: 59 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.905974:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082304:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.906136:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.906147:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.906153:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.906215:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789427898.906221:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427898.906246:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.906284:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 59 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.906300:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 58 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.906309:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.906321:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427898.906325:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789427898.906449:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+58:11369:x1876350931628032:12345-192.168.202.24@tcp:101:bash.0 Request processed in 5078us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.906459:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:3.0:1789427898.908890:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.909317:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628416 00000100:00100000:1.0:1789427898.909342:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628416 00000100:00100000:1.0:1789427898.909460:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1789427898.909472:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+58:11369:x1876350931628416:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:1.0:1789427898.909757:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+59:11369:x1876350931628416:12345-192.168.202.24@tcp:35:bash.0 Request processed in 286us (876us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789427898.909765:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1789427898.967121:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.967497:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628544 00000100:00100000:3.0:1789427898.967511:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628544 00000100:00100000:3.0:1789427898.967594:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:3.0:1789427898.967608:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+59:11375:x1876350931628544:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427898.967643:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.967997:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ca3 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968253:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968274:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968314:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427898.968375:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789427898.968380:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427898.968403:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968460:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ca3 expref: 61 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968488:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ca3 expref: 60 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.968498:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:3.0:1789427898.968502:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427898.968506:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208000, rc 0) 00000100:00100000:3.0:1789427898.968637:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931628544:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1032us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.968646:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:1.0:1789427898.972622:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427898.972869:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628672 00000100:00100000:2.0:1789427898.972956:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628672 00000100:00100000:2.0:1789427898.973127:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:2.0:1789427898.973150:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931628672:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427898.973179:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.973208:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300caa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973293:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973311:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973326:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973339:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973347:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973354:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973502:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973513:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973521:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.973575:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789427898.973580:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427898.973602:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973616:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973625:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973631:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973638:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.973646:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.973650:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977309:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977403:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427898.977406:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.977430:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977440:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518b9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977467:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977476:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977483:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977490:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427898.977495:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977503:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977512:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:2.0:1789427898.977514:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427898.977518:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.977524:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ba5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.978508:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518b97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300caa expref: 62 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.978542:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300caa expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.978552:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.978555:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427898.978558:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427898.979050:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+61:11375:x1876350931628672:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 5908us (6438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.979061:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:0.0:1789427898.986693:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427898.987646:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.987913:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629056 00000100:00100000:3.0:1789427898.987927:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629056 00000100:00100000:3.0:1789427898.988025:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1789427898.988038:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+61:2395:x1876350931629056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.988059:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.988091:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518bac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300caa expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.988134:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.988141:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.988211:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+60:2395:x1876350931629056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 175us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.988218:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789427898.989277:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931628928 00000100:00100000:2.0:1789427898.989287:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931628928 00000100:00100000:2.0:1789427898.989339:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:2.0:1789427898.989349:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931628928:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427898.989375:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.989401:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518bb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cb1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.989553:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.989570:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 61 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.989580:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.989631:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 61 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.989646:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 61 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.989759:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082432:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427898.989885:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427898.995105:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427898.995317:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629184 00000100:00100000:3.0:1789427898.995330:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629184 00010000:00010000:3.0:1789427898.995385:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 62 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.995469:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:3.0:1789427898.995481:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+62:2397:x1876350931629184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.995500:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.995509:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 62 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.995525:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 62 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.995552:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427898.995558:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.995570:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.995580:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.995615:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.995870:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+62:2397:x1876350931629184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 390us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.995888:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00010000:00010000:2.0:1789427898.996051:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c9c expref: 61 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.996070:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940082432:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427898.996101:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.996113:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.996120:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.996242:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789427898.996439:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518bb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 62 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.996459:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 61 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.996480:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427898.996485:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427898.996487:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9a00, rc 0) 00000100:00100000:2.0:1789427898.996519:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+61:11375:x1876350931628928:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 7173us (9842us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789427898.996527:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:0.0:1789427899.001084:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.001181:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629440 00000100:00100000:3.0:1789427899.001195:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629440 00000100:00100000:3.0:1789427899.001314:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1789427899.001328:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+61:11375:x1876350931629440:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:3.0:1789427899.001349:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.001380:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518b0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c80 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.001404:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427899.001409:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427899.001609:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931629440:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 283us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.001617:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789427899.004223:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.004318:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629568 00000100:00100000:3.0:1789427899.004329:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629568 00000100:00100000:3.0:1789427899.004466:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:3.0:1789427899.004477:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931629568:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:3.0:1789427899.004649:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.004685:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.004711:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427899.005336:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789427899.005562:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931629568:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 1086us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.005573:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:1.0:1789427899.008727:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.008941:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629696 00000100:00100000:2.0:1789427899.008963:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629696 00000100:00100000:2.0:1789427899.009135:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:2.0:1789427899.009147:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+60:11375:x1876350931629696:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427899.009178:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.009209:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cb8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009286:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009299:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009327:0:6483:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009343:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009382:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427899.009387:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427899.009392:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.009400:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9e00, rc 0) 00000100:00100000:2.0:1789427899.009511:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+61:11375:x1876350931629696:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 366us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.009520:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000040:00080000:0.0:1789427899.120714:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427899.120728:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427899.120797:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789427899.120811:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427899.121043:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195844a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940082560:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789427899.121198:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427899.126520:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.126622:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629824 00000100:00100000:2.0:1789427899.126635:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629824 00000100:00100000:2.0:1789427899.126711:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:2.0:1789427899.126724:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931629824:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427899.126769:0:6482:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427899.127073:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931629824:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 350us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.127082:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:0.0:1789427899.127456:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195844a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940082560:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427899.131727:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427899.132465:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931629952 00000100:00100000:1.0:1789427899.132478:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931629952 00000100:00100000:1.0:1789427899.132599:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:1.0:1789427899.132612:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+61:11376:x1876350931629952:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789427899.132707:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132729:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132743:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132774:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132805:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132812:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132843:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132854:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.132861:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427899.135015:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789427899.135026:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427899.135046:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135063:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135069:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135075:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135079:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427899.135082:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135332:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135347:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427899.135349:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427899.135354:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135358:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518bd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135374:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135378:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135382:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135385:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427899.135386:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135389:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135393:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff919581d4e400) 00010000:00010000:1.0:1789427899.135394:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427899.135396:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135406:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518bdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135453:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135457:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135461:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135464:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427899.135465:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135469:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135473:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:1.0:1789427899.135475:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427899.135477:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.135480:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede518be4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.135581:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+61:11376:x1876350931629952:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 2967us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.135591:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:1.0:1789427899.140381:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.140538:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931630208 00000100:00100000:2.0:1789427899.140550:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931630208 00000100:00100000:2.0:1789427899.140624:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1789427899.140638:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+61:11376:x1876350931630208:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.140667:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.140695:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518beb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cbf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.140867:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.140900:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.140915:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427899.140929:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789427899.141062:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141070:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141078:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141085:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.141090:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141098:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141112:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427899.141115:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789427899.141122:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141139:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141187:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518beb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cbf expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141198:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427899.141201:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427899.141205:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518beb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cbf expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.141214:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9800, rc 0) 00000100:00100000:2.0:1789427899.141287:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630208:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 653us (922us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789427899.141295:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:1.0:1789427899.144116:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.144202:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931630336 00000100:00100000:3.0:1789427899.144212:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931630336 00000100:00100000:3.0:1789427899.144275:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:3.0:1789427899.144287:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630336:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789427899.144327:0:10064:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789427899.144465:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630336:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.144473:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:1.0:1789427899.147219:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.147299:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931630592 00000100:00100000:2.0:1789427899.147312:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931630592 00000100:00100000:2.0:1789427899.147381:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:2.0:1789427899.147391:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630592:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.147443:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.147448:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789427899.147480:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518b90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ca3 expref: 62 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.147505:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427899.147511:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427899.147546:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cc6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427899.148039:0:6483:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789427899.148214:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.148229:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.148241:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.148296:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cc6 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.148314:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cc6 expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.148322:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406d00) 00010000:00010000:2.0:1789427899.148325:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427899.148327:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9000, rc 0) 00000100:00100000:2.0:1789427899.148394:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+63:11376:x1876350931630592:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1004us (1187us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789427899.148402:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:1.0:1789427899.152944:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.153055:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931630848 00000100:00100000:0.0:1789427899.153066:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931630848 00000100:00100000:0.0:1789427899.153132:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:0.0:1789427899.153320:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+63:11376:x1876350931630848:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789427899.153391:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427899.153459:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518c07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cc6 expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.153482:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406d00) 00010000:00010000:0.0:1789427899.153496:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427899.153524:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.153540:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.153551:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155594:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155631:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155646:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155706:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155713:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155719:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155725:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.155729:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155736:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155747:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427899.155750:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.155755:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155761:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518c15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155776:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155788:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155794:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155798:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.155801:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155807:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155814:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x11f6b417 (ffff919583550a00) 00010000:00010000:0.0:1789427899.155817:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.155820:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.155825:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x11f6b417 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.156021:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630848:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 2701us (3084us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427899.156031:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:1.0:1789427899.161116:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.161212:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931630976 00000100:00100000:2.0:1789427899.161229:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931630976 00000100:00100000:2.0:1789427899.161315:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:2.0:1789427899.161331:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+62:11376:x1876350931630976:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.161381:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.161626:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ccd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161677:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161695:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161709:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161853:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 64 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161874:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 63 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.161884:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:2.0:1789427899.161887:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427899.161891:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9800, rc 0) 00000100:00100000:2.0:1789427899.161986:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+63:11376:x1876350931630976:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 660us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.161993:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:1.0:1789427899.166396:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.166717:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931631232 00000100:00100000:3.0:1789427899.166729:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931631232 00000100:00100000:3.0:1789427899.166794:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:3.0:1789427899.166805:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+63:11376:x1876350931631232:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427899.166893:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.166910:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.166923:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427899.167124:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1789427899.167194:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000087001790 reply state 00000000b384643c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.167209:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.167217:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:3.0:1789427899.167220:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789427899.167224:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427899.167486:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+65:11376:x1876350931631232:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 681us (1098us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789427899.167494:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:1.0:1789427899.170208:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.170291:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931631360 00000100:00100000:0.0:1789427899.170299:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931631360 00000100:00100000:0.0:1789427899.170349:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:0.0:1789427899.170358:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+65:11376:x1876350931631360:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427899.170377:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427899.170404:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cd4 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.170493:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 66 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.170507:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 66 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.170525:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.170528:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427899.170532:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f000, rc 0) 00000100:00100000:0.0:1789427899.170574:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+66:11376:x1876350931631360:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 217us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.170581:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:2.0:1789427899.172924:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.173025:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931631488 00000100:00100000:3.0:1789427899.173034:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931631488 00000100:00100000:3.0:1789427899.173109:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1789427899.173119:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931631488:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789427899.173323:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+9:2396:x1876350931631488:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 205us (404us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789427899.173331:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00080000:1.0:1789427899.173477:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427899.175328:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.175402:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931631744 00000100:00100000:2.0:1789427899.175410:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931631744 00000100:00100000:2.0:1789427899.175487:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1789427899.175510:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+66:11376:x1876350931631744:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789427899.175699:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+67:11376:x1876350931631744:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 190us (373us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789427899.175707:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789427899.177796:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.177892:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632000 00000100:00100000:2.0:1789427899.177900:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632000 00000100:00100000:2.0:1789427899.177966:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:2.0:1789427899.177975:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+67:11376:x1876350931632000:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789427899.178079:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+67:11376:x1876350931632000:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.178086:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:3.0:1789427899.180206:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.180388:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632128 00000100:00100000:2.0:1789427899.180397:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632128 00000100:00100000:2.0:1789427899.180468:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:2.0:1789427899.180477:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+67:11376:x1876350931632128:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.180495:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.180515:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cdb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180577:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180592:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180604:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427899.180664:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427899.180683:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180709:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cdb expref: 69 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180728:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cdb expref: 68 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.180737:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:2.0:1789427899.180740:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789427899.180743:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9200, rc 0) 00000100:00100000:2.0:1789427899.180851:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+68:11376:x1876350931632128:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 375us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.180858:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:3.0:1789427899.183404:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.183647:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632256 00000100:00100000:2.0:1789427899.183656:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632256 00000100:00100000:2.0:1789427899.183737:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:2.0:1789427899.183747:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+9:2396:x1876350931632256:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.183762:0:13777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.183779:0:13777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ce2 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427899.183802:0:13777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880ba, blocks: 0x0 00010000:00010000:2.0:1789427899.183819:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=243s v=(0 0) 00010000:00010000:2.0:1789427899.183833:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427899.183842:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 10 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.183859:0:13777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 10 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.183872:0:13777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9000, rc 0) 00000100:00100000:2.0:1789427899.183923:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931632256:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 178us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.183930:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789427899.192539:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.192808:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632512 00000100:00100000:3.0:1789427899.192817:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632512 00000100:00100000:0.0:1789427899.193082:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:0.0:1789427899.193093:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+68:11376:x1876350931632512:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789427899.193195:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+68:11376:x1876350931632512:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 104us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.193203:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:3.0:1789427899.195335:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427899.195453:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632640 00000100:00100000:1.0:1789427899.195461:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632640 00000100:00100000:1.0:1789427899.195498:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1789427899.195507:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+10:11376:x1876350931632640:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427899.195522:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427899.195541:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ce9 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.195570:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.195580:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427899.195585:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427899.195590:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.195625:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.195658:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.195671:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940082688:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427899.195752:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427899.197489:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940082688:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427899.197515:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.197542:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47800, rc 0) 00000100:00100000:3.0:1789427899.197593:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+11:11376:x1876350931632640:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 2086us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.197602:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1789427899.199382:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.199468:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632768 00000100:00100000:2.0:1789427899.199476:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632768 00010000:00010000:2.0:1789427899.199507:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.199546:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:2.0:1789427899.199556:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688833050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931632768:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427899.199570:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427899.199591:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.199604:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.199624:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce2 expref: 11 pid: 13777 timeout: 343 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.199646:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427899.199650:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427899.199659:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.199669:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.199699:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.199711:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940082816:192.168.202.24@tcp:105: 00000100:00100000:2.0:1789427899.199765:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427899.202439:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940082816:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789427899.202461:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427899.202509:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688833050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+10:2397:x1876350931632768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2954us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.202517:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:1.0:1789427899.212821:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.218192:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931632896 00000100:00100000:2.0:1789427899.218209:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931632896 00002000:00100000:0.0:1789427899.220685:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff919584448e00 x1876350931632896/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:145/0 lens 504/0 e 0 to 0 dl 1789427910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789427899.220700:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919584448e00 with x1876350931632896 ext(0->12) 00002000:00010000:0.0:1789427899.220707:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919584448e00 00000100:00100000:0.0:1789427899.220769:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:0.0:1789427899.220780:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931632896:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789427899.222395:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+12:2396:x1876350931632896:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 1612us (9579us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789427899.222407:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00002000:00100000:1.0:1789427899.222437:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff919584448e00 x1876350931632896/t4294967309(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:145/0 lens 504/448 e 0 to 0 dl 1789427910 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427899.222447:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919584448e00 with x1876350931632896 ext(0->12) 00002000:00010000:1.0:1789427899.222453:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919584448e00 00000100:00100000:1.0:1789427899.233303:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.233523:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633024 00000100:00100000:3.0:1789427899.233533:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633024 00000100:00100000:3.0:1789427899.233598:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:3.0:1789427899.233610:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+68:11376:x1876350931633024:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789427899.243110:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789427899.243154:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1789427899.243546:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243562:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243571:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243577:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883ac00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.243582:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243590:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243607:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff919581d49f00) 00010000:00010000:0.0:1789427899.243610:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.243615:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243622:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883ac00/0x84fc867ede518959 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243647:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243654:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243682:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243687:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883bc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.243690:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243697:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243706:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff919688862300) 00010000:00010000:0.0:1789427899.243709:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.243712:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243718:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883bc00/0x84fc867ede518a01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243734:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243740:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243746:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243751:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883be00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.243754:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243771:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243779:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:0.0:1789427899.243782:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.243785:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243791:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883be00/0x84fc867ede518a7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243802:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243809:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243814:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243819:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883b400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.243822:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243828:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243835:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919688862a00) 00010000:00010000:0.0:1789427899.243838:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.243841:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243854:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b400/0x84fc867ede518aa2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.243871:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244060:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244067:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244073:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.244076:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244082:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244091:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:0.0:1789427899.244094:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.244097:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244103:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518b74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244116:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244123:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244134:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244139:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.244141:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244148:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244155:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.244157:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789427899.244160:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.244165:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.247382:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940082944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789427899.247474:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.247709:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940082944 00000100:00100000:3.0:1789427899.247717:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940082944 00000100:00100000:3.0:1789427899.247779:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427899.247789:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940082944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789427899.247813:0:8400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1789427899.247844:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa880ba, atime: 0x6aa880ba, ctime: 0x6aa880ba, blocks: 0x8 00010000:00010000:3.0:1789427899.247851:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.247867:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=243s v=(0 0) 00010000:00010000:3.0:1789427899.247871:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427899.247890:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.247903:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.247932:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.247941:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.247969:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427899.248112:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876350940082944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 324us (638us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789427899.248119:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:3.0:1789427899.248292:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9196bfacca80/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789427899.248299:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940082944:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789427899.248517:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789427899.248614:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427899.248623:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.248631:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427899.248636:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.248657:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.248675:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.248683:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000977936/0x84fc867ede518c5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.248702:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427899.248703:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427899.248705:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789427899.252123:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196ae87a6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789427899.252134:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837faa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9196ae87acc0 00000020:00080000:2.0:1789427899.252152:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837fa000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919698b33a00 00000004:00080000:2.0:1789427899.252198:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789427899.252237:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196ae87a540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789427899.252240:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837fa800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9196ae87a3c0 00000020:00080000:2.0:1789427899.252243:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837fac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919584478600 00000020:00080000:2.0:1789427899.252255:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789427899.252386:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427899.252402:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940083072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789427899.252483:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427899.252538:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940083072 00000100:00100000:2.0:1789427899.252545:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940083072 00000100:00100000:2.0:1789427899.252598:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427899.252608:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940083072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789427899.252634:0:13777:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789427899.252658:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.252679:0:13777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.252688:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789427899.252693:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427899.252698:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.252727:0:13777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.252749:0:13777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 11 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.252761:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13777:1876350940083200:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427899.252814:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698c8d900 going to sleep for 11 seconds 00000100:00080000:2.0:1789427899.252826:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1789427899.253112:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789427899.253173:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789427899.255474:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+16:11376:x1876350931633024:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 20395us (20709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.255488:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:1.0:1789427899.258479:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427899.258556:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.258652:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13777:1876350940083200:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427899.258680:0:13777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.258752:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633152 00000100:00100000:3.0:1789427899.258759:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633152 00010000:00010000:3.0:1789427899.258793:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 12 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.258833:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:3.0:1789427899.258842:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+12:2397:x1876350931633152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427899.258856:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.258861:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 12 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.258874:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 12 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.258910:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063ddb9a4/0x84fc867ede518a0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c41 expref: 12 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.258926:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427899.258930:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427899.258935:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.258955:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.258990:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427899.259036:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931633152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 195us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.259044:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 74 00010000:00010000:1.0:1789427899.259098:0:13777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.259108:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.259117:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.259125:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.259151:0:13777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789427899.259309:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3615:x1876350940083072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6702us (6825us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789427899.259316:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427899.259330:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633280 00000100:00100000:1.0:1789427899.259333:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633280 00000100:00100000:1.0:1789427899.259359:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789427899.259366:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931633280:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789427899.259628:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91958444c380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789427899.259641:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940083072:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789427899.259913:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427899.259920:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.259929:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427899.259934:0:9487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.259943:0:9487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.259981:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.259989:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a1659d/0x84fc867ede518c62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.260006:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427899.260008:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427899.260010:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789427899.261248:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789427899.261258:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789427899.264896:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931633280:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 5520us (6330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.264910:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789427899.267511:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.267624:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633536 00000100:00100000:0.0:1789427899.267635:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633536 00000100:00100000:0.0:1789427899.267696:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:0.0:1789427899.267705:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+16:11376:x1876350931633536:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789427899.267786:0:8108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427899.267817:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518c46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cdb expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.267840:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.267847:0:8108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427899.267887:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.267905:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.267917:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427899.275240:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c2837bde reply state 000000006f896c4e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.275269:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.275278:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.275280:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427899.275285:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427899.275455:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+17:11376:x1876350931633536:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 7745us (7950us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789427899.275466:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:1.0:1789427899.279549:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.279736:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633664 00000100:00100000:3.0:1789427899.279748:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633664 00000100:00100000:3.0:1789427899.279824:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789427899.279835:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931633664:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789427899.280124:0:8902:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789427899.280129:0:8902:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789427898 00002000:00010000:3.0:1789427899.280131:0:8902:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789427898 00002000:00010000:3.0:1789427899.280134:0:8902:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789427898 -> 1789427898 00002000:00010000:3.0:1789427899.280136:0:8902:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789427899.280196:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931633664:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 362us (663us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789427899.280204:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1789427899.286038:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.286091:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931633920 00000100:00100000:0.0:1789427899.286104:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931633920 00000100:00100000:0.0:1789427899.286195:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:0.0:1789427899.286403:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+17:11376:x1876350931633920:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789427899.286998:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.287061:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.287070:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.287115:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.287185:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 17 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.287200:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940083328:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427899.287585:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789427899.290464:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.290541:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634048 00000100:00100000:3.0:1789427899.290553:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634048 00010000:00010000:3.0:1789427899.290603:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 18 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.290673:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 75 00000100:00100000:3.0:1789427899.290686:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931634048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427899.290705:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.290714:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 18 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.290729:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 18 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.290757:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:3.0:1789427899.290762:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.290770:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.290777:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.290794:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427899.290861:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931634048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 179us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.290867:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 75 00010000:00010000:2.0:1789427899.291063:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ccd expref: 17 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.291084:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940083328:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427899.291110:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291120:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291127:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291193:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291201:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291208:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291215:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.291220:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291229:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291238:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:2.0:1789427899.291242:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789427899.291246:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.291253:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518c70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.291308:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+16:11376:x1876350931633920:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 4983us (5281us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789427899.291317:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789427899.297981:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.298144:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634176 00000100:00100000:3.0:1789427899.298157:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634176 00000100:00100000:3.0:1789427899.298286:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1789427899.298300:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931634176:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789427899.298380:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.298406:0:8400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.298454:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427899.298459:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427899.298465:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.298513:0:8400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.298531:0:8400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 7 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.298549:0:8400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8400:1876350940083456:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427899.298649:0:8400:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427899.303061:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427899.303330:0:8400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8400:1876350940083456:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427899.303366:0:8400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.320662:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634304 00000100:00100000:2.0:1789427899.320683:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634304 00010000:00010000:2.0:1789427899.320757:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 8 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.320935:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:2.0:1789427899.320988:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931634304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427899.321010:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427899.321039:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 8 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.321065:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 8 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.321095:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e3f496/0x84fc867ede518c54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ce9 expref: 8 pid: 8401 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.321117:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427899.321122:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427899.321129:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.321141:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.321199:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427899.321228:0:8400:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321239:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321263:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321271:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321280:0:8400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321297:0:8400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427899.321302:0:8400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321312:0:8400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321325:0:8400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.321333:0:8400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000977936/0x84fc867ede518c77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.321370:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931634304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 423us (18322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.321378:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:1.0:1789427899.321388:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931634176:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 23094us (23424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.321396:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1789427899.326329:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.326671:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634560 00000100:00100000:2.0:1789427899.326683:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634560 00000100:00100000:2.0:1789427899.326762:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:2.0:1789427899.326774:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+16:11376:x1876350931634560:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789427899.326902:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.326924:0:10064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 16 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.326937:0:10064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.326996:0:10064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 16 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.327022:0:10064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 16 pid: 10064 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.327234:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940083584:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427899.327337:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698c8d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427899.332163:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.332312:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940083584:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427899.332328:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634688 00000100:00100000:3.0:1789427899.332338:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634688 00010000:00010000:2.0:1789427899.332350:0:10064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332390:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 17 pid: 10064 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.332483:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:3.0:1789427899.332496:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+17:2397:x1876350931634688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427899.332645:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.332655:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 17 pid: 10064 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332671:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 17 pid: 10064 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332695:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883a200/0x84fc867ede518b6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c95 expref: 17 pid: 10064 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332711:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427899.332716:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332725:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332732:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332738:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.332763:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427899.332790:0:10064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.332798:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.332835:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+16:2397:x1876350931634688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 341us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.332843:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00010000:00010000:2.0:1789427899.335626:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.335667:0:10064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 16 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.335679:0:10064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.335736:0:10064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 16 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.335757:0:10064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 16 pid: 8108 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.335776:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940083712:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427899.336239:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698c8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427899.340573:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940083712:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427899.340617:0:10064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.343225:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.344042:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634816 00000100:00100000:0.0:1789427899.344057:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634816 00010000:00010000:0.0:1789427899.344128:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 17 pid: 8108 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.344568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:0.0:1789427899.344584:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+17:2396:x1876350931634816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427899.344610:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427899.344618:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 17 pid: 8108 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344636:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 17 pid: 8108 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344669:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518c38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cd4 expref: 17 pid: 8108 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344692:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.344699:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344712:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344722:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.344796:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427899.344891:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+16:2396:x1876350931634816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 312us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.344900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00010000:00010000:3.0:1789427899.344971:0:10064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.344989:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427899.345224:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789427899.345375:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789427899.345691:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789427899.345794:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10064:1876350940083840:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789427899.345864:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.345963:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509300 going to sleep for 11 seconds 00000100:00100000:1.0:1789427899.346804:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940083840 00000100:00100000:1.0:1789427899.346816:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940083840 00000100:00100000:1.0:1789427899.346905:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789427899.346916:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10064:x1876350940083840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789427899.347136:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10064:x1876350940083840:12345-0@lo:1000:mdt00_004.0 Request processed in 221us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.347144:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789427899.347290:0:10064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789427899.347297:0:10064:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1789427899.347319:0:10064:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91958444c380, transno 4294967310 00000100:00100000:2.0:1789427899.347337:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10064:1876350940083840:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789427899.347645:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789427899.347700:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10064:1876350940083968:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789427899.347745:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427899.351804:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698509480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427899.353734:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940083968 00000100:00100000:3.0:1789427899.353754:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940083968 00000100:00100000:3.0:1789427899.353838:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789427899.353852:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10064:x1876350940083968:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789427899.355936:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10064:x1876350940083968:12345-0@lo:1000:mdt00_004.0 Request processed in 2076us (8179us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789427899.355961:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789427899.356045:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10064:1876350940083968:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789427899.356118:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356132:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356141:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356148:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.356154:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356164:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356185:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:2.0:1789427899.356189:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427899.356195:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356203:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356236:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356243:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356271:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356277:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.356280:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356287:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356296:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427899.356299:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427899.356307:0:10064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356322:0:10064:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356332:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.356378:0:10064:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.356396:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940084096:192.168.202.24@tcp:105: 00000100:00100000:2.0:1789427899.356599:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427899.362662:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.362775:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931634944 00000100:00100000:0.0:1789427899.362788:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931634944 00000100:00100000:0.0:1789427899.362860:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:0.0:1789427899.362872:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:11375:x1876350931634944:12345-192.168.202.24@tcp:49:lfs.0 00000100:00100000:0.0:1789427899.363194:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:11375:x1876350931634944:12345-192.168.202.24@tcp:49:lfs.0 Request processed in 324us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.363203:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1789427899.366466:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940084096:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789427899.366647:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366661:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518bc8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366711:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366730:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366745:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366757:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366764:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366771:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366777:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.366782:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366791:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366805:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427899.366808:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427899.366821:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366827:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c8c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366840:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366847:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366853:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366858:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427899.366861:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366868:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366876:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427899.366879:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427899.366881:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.366887:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518c7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.367130:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+19:11376:x1876350931634560:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 40357us (40817us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789427899.367151:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000020:00080000:2.0:1789427899.367165:0:10064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789427899.367335:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427899.367341:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427899.368772:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789427899.368790:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427899.371799:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.371910:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931635200 00000100:00100000:0.0:1789427899.371924:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931635200 00000100:00100000:0.0:1789427899.372022:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:0.0:1789427899.372627:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+19:11375:x1876350931635200:12345-192.168.202.24@tcp:58:lfs.0 00000040:00080000:0.0:1789427899.372821:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789427899.372921:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+19:11375:x1876350931635200:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 302us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.372931:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:1.0:1789427899.389930:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.390252:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931635456 00000100:00100000:3.0:1789427899.390266:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931635456 00000100:00100000:3.0:1789427899.390339:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:3.0:1789427899.390351:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+19:11376:x1876350931635456:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789427899.390971:0:6485:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789427899.391313:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789427899.391359:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391399:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391694:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391708:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391715:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391722:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.391746:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427899.391925:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+21:11376:x1876350931635456:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1573us (2007us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789427899.391937:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000020:00080000:3.0:1789427899.391953:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789427899.392101:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427899.392110:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.392132:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427899.392137:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.392155:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.392170:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427899.392174:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427899.392179:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.392186:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518c93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.392200:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427899.392202:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427899.392204:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427899.412054:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427899.412223:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931635584 00000100:00100000:2.0:1789427899.412238:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931635584 00000100:00100000:2.0:1789427899.412339:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:2.0:1789427899.412351:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:11378:x1876350931635584:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427899.412383:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.412411:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cf0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412553:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412571:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412585:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412602:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412611:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412618:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412713:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412725:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412758:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412801:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.412816:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 22 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.412832:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940084224:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427899.414071:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427899.422485:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940084224:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427899.422525:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.422677:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427899.422888:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931635840 00000100:00100000:0.0:1789427899.422898:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931635840 00000100:00100000:0.0:1789427899.422967:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:0.0:1789427899.422979:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+23:6153:x1876350931635840:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789427899.423377:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:6153:x1876350931635840:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 400us (969us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789427899.423384:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1789427899.428862:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427899.429020:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931635968 00000100:00100000:3.0:1789427899.429037:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931635968 00010000:00010000:3.0:1789427899.429099:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 24 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.429257:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:3.0:1789427899.429269:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:2396:x1876350931635968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427899.429292:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.429302:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 24 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429337:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 24 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429365:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518bba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb1 expref: 24 pid: 6482 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429383:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427899.429389:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429400:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429410:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.429504:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427899.429542:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429553:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427899.429625:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789427899.429630:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427899.429654:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429670:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429682:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429689:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429697:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429704:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.429710:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429719:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429730:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:0.0:1789427899.429733:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.429737:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429744:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429770:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429777:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429782:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429787:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427899.429791:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429797:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429805:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff919698406c00) 00010000:00010000:0.0:1789427899.429807:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.429810:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429816:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.429859:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518c9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf0 expref: 24 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.430211:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf0 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.430233:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:0.0:1789427899.430235:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427899.430237:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9000, rc 0) 00000100:00100000:0.0:1789427899.430303:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+23:2396:x1876350931635968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1036us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.430312:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:0.0:1789427899.430352:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:11378:x1876350931635584:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 18004us (18306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.430358:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:3.0:1789427899.696842:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427899.696889:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940084352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427899.696993:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427899.697237:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940084352 00000100:00100000:1.0:1789427899.697266:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940084352 00000100:00100000:1.0:1789427899.697329:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427899.697341:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940084352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427899.697398:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789427899.697488:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940084352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.697497:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789427899.697667:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940084352:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427899.825664:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427900.237463:0:14272:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427900.237472:0:14272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427900.237513:0:14272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789427900.237520:0:14272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789427900.413572:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427900.413581:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427900.413603:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789427900.413610:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427900.413745:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195844a3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940084480:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789427900.413850:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195836b8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789427900.432226:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427900.432262:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931636096 00000100:00100000:1.0:1789427900.432272:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931636096 00000100:00100000:1.0:1789427900.432337:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:1.0:1789427900.432348:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+23:11390:x1876350931636096:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789427900.432383:0:10064:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789427900.432526:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+23:11390:x1876350931636096:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 179us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427900.432534:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00080000:1.0:1789427900.432569:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427900.432675:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195844a3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940084480:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427900.437347:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427900.437618:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931636352 00000100:00100000:3.0:1789427900.437627:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931636352 00000100:00100000:3.0:1789427900.437682:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:3.0:1789427900.437692:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+22:11390:x1876350931636352:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427900.437712:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427900.437733:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518cb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cf7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.437846:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518cbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.437861:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.437885:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427900.437897:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789427900.438495:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518cb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf7 expref: 25 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427900.438517:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf7 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427900.438526:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427900.438529:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427900.438533:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208800, rc 0) 00000100:00100000:2.0:1789427900.438590:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:11390:x1876350931636352:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 899us (1252us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789427900.438597:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:0.0:1789427900.460481:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427900.460524:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427900.460555:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931636736 00000100:00100000:0.0:1789427900.460564:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931636736 00000100:00100000:0.0:1789427900.461077:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:0.0:1789427900.461088:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688833450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+24:2395:x1876350931636736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427900.461104:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427900.461130:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518cbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf7 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.461178:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:0.0:1789427900.461184:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427900.461240:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688833450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+23:2395:x1876350931636736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 153us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427900.461247:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789427900.463572:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931636608 00000100:00100000:3.0:1789427900.463588:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931636608 00000100:00100000:3.0:1789427900.463666:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:3.0:1789427900.463675:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+23:11390:x1876350931636608:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427900.463749:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463765:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463777:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463926:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463944:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463952:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463969:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427900.463974:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463981:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.463994:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:3.0:1789427900.463997:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427900.464002:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427900.464008:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518ccb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427900.464307:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:11390:x1876350931636608:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 631us (3832us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789427900.464315:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144 00000040:00080000:3.0:1789427900.464566:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427900.464570:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427900.465115:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789427900.465124:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427900.471899:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427900.482707:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931636992 00000100:00100000:3.0:1789427900.482724:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931636992 00000100:00100000:0.0:1789427900.483446:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:0.0:1789427900.483459:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:11390:x1876350931636992:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427900.483697:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+25:11390:x1876350931636992:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 240us (11806us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789427900.483705:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00010000:00010000:2.0:1789427900.849469:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427901.876842:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427902.207302:0:14324:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427902.208456:0:14324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427902.208492:0:14324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789427902.208499:0:14324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427902.257075:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427902.257097:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940084608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427902.257179:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.257242:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940084608 00000100:00100000:3.0:1789427902.257257:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940084608 00000100:00100000:3.0:1789427902.257318:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789427902.257328:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940084608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427902.257361:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427902.257408:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940084608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.257435:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789427902.257484:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940084608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427902.458307:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.458353:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.458460:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.458484:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427902.459061:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637120 00000100:00100000:2.0:1789427902.459072:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637120 00000100:00100000:2.0:1789427902.459125:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 376 00000100:00100000:2.0:1789427902.459136:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931637120:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427902.459203:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931637120:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 69us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427902.459211:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 376 00000100:00100000:1.0:1789427902.462472:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637632 00000100:00100000:1.0:1789427902.462488:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637632 00000100:00100000:1.0:1789427902.462559:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:1.0:1789427902.462571:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931637632:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427902.462654:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931637632:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 86us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.462662:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00080000:1.0:1789427902.462689:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427902.462910:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427902.474409:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637376 00000100:00100000:3.0:1789427902.474486:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637376 00000100:00100000:3.0:1789427902.474607:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637888 00000100:00100000:3.0:1789427902.474610:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637888 00000100:00100000:3.0:1789427902.474634:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:3.0:1789427902.474643:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931637376:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427902.474711:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931637376:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 69us (16358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.474718:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:3.0:1789427902.474734:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:3.0:1789427902.474740:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931637888:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427902.474757:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931637888:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 18us (16274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.474763:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:0.0:1789427902.478735:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.478765:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637504 00000100:00100000:0.0:1789427902.478774:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637504 00000100:00100000:0.0:1789427902.478821:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:0.0:1789427902.478831:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931637504:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427902.478905:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931637504:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427902.478912:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:0.0:1789427902.478965:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.479004:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637248 00000100:00100000:0.0:1789427902.479009:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637248 00000100:00100000:0.0:1789427902.479034:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:0.0:1789427902.479039:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+25:2397:x1876350931637248:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427902.479069:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+25:2397:x1876350931637248:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (16160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427902.479075:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:0.0:1789427902.479084:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931637760 00000100:00100000:0.0:1789427902.479087:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931637760 00000100:00100000:0.0:1789427902.479104:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00100000:0.0:1789427902.479110:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931637760:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427902.479129:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931637760:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 19us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427902.479134:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00080000:0.0:1789427902.480685:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427902.480693:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427902.480695:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789427902.517715:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427902.517725:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427902.517744:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789427902.517751:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427902.576109:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427902.584800:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638144 00000100:00100000:0.0:1789427902.584817:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638144 00000100:00100000:0.0:1789427902.584902:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 145 00000100:00100000:0.0:1789427902.584924:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+25:11411:x1876350931638144:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427902.584946:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427902.584967:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518cd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300cfe expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.585085:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede518cd9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.585114:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede518cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.585129:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede518cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427902.585141:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789427902.585235:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518cd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cfe expref: 28 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.585253:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede518cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cfe expref: 27 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.585261:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:0.0:1789427902.585264:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427902.585268:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e400, rc 0) 00000100:00100000:0.0:1789427902.585559:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+27:11411:x1876350931638144:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 646us (9459us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789427902.585566:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 145 00000100:00100000:1.0:1789427902.602055:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427902.602087:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638272 00000100:00100000:1.0:1789427902.602096:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638272 00000100:00100000:1.0:1789427902.602139:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:1.0:1789427902.602148:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:11411:x1876350931638272:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:1.0:1789427902.602285:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602303:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602322:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602364:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602372:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602380:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602387:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427902.602392:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602400:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602411:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:1.0:1789427902.602431:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427902.602436:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.602443:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47c00/0x84fc867ede518ce7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427902.602912:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:11411:x1876350931638272:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 762us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.602929:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:3.0:1789427902.768759:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940084992:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.768822:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.768875:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940085504:0@lo:400:kworker.0 00000100:00100000:2.0:1789427902.769089:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940085120:0@lo:400:kworker.0 00000100:00100000:2.0:1789427902.769128:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940084992 00000100:00100000:2.0:1789427902.769136:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940084992 00000100:00100000:2.0:1789427902.769180:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789427902.769188:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427902.769234:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940084992:12345-0@lo:400:kworker.0 Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427902.769240:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789427902.769296:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.769327:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940086016:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.769349:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.769383:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919581dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940084992:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.769408:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085504 00000100:00100000:3.0:1789427902.769412:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085504 00000100:00100000:3.0:1789427902.769460:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086016 00000100:00100000:3.0:1789427902.769463:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086016 00000100:00100000:3.0:1789427902.769476:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789427902.769482:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940085504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.769513:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940085504:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.769518:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789427902.769530:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789427902.769535:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940086016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769665:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940084736:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769717:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769741:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940085248:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769761:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769776:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940085760:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769796:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769810:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940086272:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769825:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769843:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789427902.769849:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940084864:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769868:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769883:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940085376:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769899:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769907:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940085888:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.769937:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.769947:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940086400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427902.769964:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427902.770004:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940084736 00000100:00100000:1.0:1789427902.770007:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940084736 00000100:00100000:1.0:1789427902.770032:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789427902.770038:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940084736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770066:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3615:x1876350940084736:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.770073:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789427902.770101:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085248 00000100:00100000:1.0:1789427902.770104:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085248 00000100:00100000:1.0:1789427902.770130:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789427902.770135:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940085248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770161:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940085248:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.770166:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789427902.770182:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085760 00000100:00100000:1.0:1789427902.770185:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085760 00000100:00100000:1.0:1789427902.770207:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086272 00000100:00100000:1.0:1789427902.770209:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086272 00000100:00100000:1.0:1789427902.770227:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789427902.770232:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940085760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770257:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940085760:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.770262:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789427902.770272:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789427902.770277:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876350940086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770297:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876350940086272:12345-0@lo:400:kworker.0 Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.770303:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789427902.770319:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086400 00000100:00100000:1.0:1789427902.770322:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086400 00000100:00100000:1.0:1789427902.770342:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789427902.770347:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940086400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427902.770366:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427902.770392:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940086400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.770397:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789427902.770464:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940086400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427902.770472:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940084736:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770480:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940085248:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770488:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940085760:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770496:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940086272:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.770520:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940084864 00000100:00100000:1.0:1789427902.770523:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940084864 00000100:00100000:1.0:1789427902.770538:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085376 00000100:00100000:1.0:1789427902.770540:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085376 00000100:00100000:1.0:1789427902.770550:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085888 00000100:00100000:1.0:1789427902.770552:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085888 00000100:00100000:3.0:1789427902.770844:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940086016:12345-0@lo:400:kworker.0 Request processed in 1307us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.770852:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789427902.770866:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789427902.770872:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940084864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.770905:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940084864:12345-0@lo:400:kworker.0 Request processed in 34us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.770910:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789427902.770937:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789427902.770944:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.770979:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940085376:12345-0@lo:400:kworker.0 Request processed in 35us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.770984:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1789427902.771003:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427902.771009:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427902.771010:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427902.771013:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427902.771024:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.771046:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940085632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771068:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.771086:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940086144:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771102:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.771118:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427902.771123:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940086528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427902.771145:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427902.771168:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085632 00000100:00100000:3.0:1789427902.771172:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085632 00000100:00100000:3.0:1789427902.771196:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086144 00000100:00100000:3.0:1789427902.771199:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086144 00000100:00100000:3.0:1789427902.771212:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427902.771218:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940085632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771246:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919581dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940085632:12345-0@lo:400:kworker.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.771252:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427902.771262:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789427902.771267:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771287:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940086144:12345-0@lo:400:kworker.0 Request processed in 21us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.771298:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789427902.771312:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086528 00000100:00100000:3.0:1789427902.771316:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086528 00000100:00100000:3.0:1789427902.771332:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789427902.771337:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350940086528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427902.771346:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427902.771370:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350940086528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.771375:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789427902.771390:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427902.771397:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940085120 00000100:00100000:3.0:1789427902.771399:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940085120 00000100:00100000:3.0:1789427902.771412:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789427902.771433:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940085120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771457:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958353a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940085120:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427902.771462:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789427902.771489:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940086528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427902.771498:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940085120:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771506:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940085632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427902.771513:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940086144:0@lo:400:kworker.0 00010000:00080000:3.0:1789427902.771541:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820a80 x1876350940085504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427902.771550:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940085504:0@lo:400:kworker.0 00000100:00100000:0.0:1789427902.771719:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940084864:0@lo:400:kworker.0 00000100:00100000:0.0:1789427902.771729:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940085376:0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.771877:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789427902.771883:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940085888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427902.771994:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940085888:12345-0@lo:400:kworker.0 Request processed in 111us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.772001:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1789427902.772051:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427902.772069:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940085888:0@lo:400:kworker.0 00010000:00080000:3.0:1789427902.772238:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbd71880 x1876350940086016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427902.772247:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940086016:0@lo:400:kworker.0 00000100:00100000:2.0:1789427902.774473:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427902.774800:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638400 00000100:00100000:1.0:1789427902.774810:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638400 00000100:00100000:1.0:1789427902.774869:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:1.0:1789427902.774878:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931638400:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:1.0:1789427902.774894:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427902.774923:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b086ea/0x84fc867ede518cee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d05 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427902.774949:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa880ba, atime: 0x6aa880ba, ctime: 0x6aa880ba, blocks: 0x8 00010000:00010000:1.0:1789427902.774990:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=247s v=(0 0) 00010000:00010000:1.0:1789427902.774995:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427902.775005:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b086ea/0x84fc867ede518cee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d05 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.775266:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2b086ea/0x84fc867ede518cee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d05 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427902.775281:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47c00, rc 0) 00000100:00100000:1.0:1789427902.778013:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931638400:12345-192.168.202.24@tcp:101:cat.0 Request processed in 3125us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427902.778031:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:2.0:1789427902.785316:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427902.785466:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638528 00000100:00100000:1.0:1789427902.785477:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638528 00002000:00100000:1.0:1789427902.785539:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff91958444e680 x1876350931638528/t0(0) o3->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:148/0 lens 488/0 e 0 to 0 dl 1789427913 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427902.785551:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958444e680 with x1876350931638528 ext(0->4095) 00002000:00010000:1.0:1789427902.785557:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958444e680 00000100:00100000:1.0:1789427902.785597:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1789427902.785809:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931638528:12345-192.168.202.24@tcp:3:cat.0 00000100:00100000:1.0:1789427902.785996:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931638528:12345-192.168.202.24@tcp:3:cat.0 Request processed in 390us (689us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789427902.786004:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00002000:00100000:1.0:1789427902.786011:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff91958444e680 x1876350931638528/t0(0) o3->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:148/0 lens 488/4536 e 0 to 0 dl 1789427913 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427902.786260:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958444e680 with x1876350931638528 ext(0->4095) 00002000:00010000:1.0:1789427902.786263:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958444e680 00010000:00010000:2.0:1789427902.896860:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789427902.897976:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:2.0:1789427903.794131:0:8901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 248288713195ns, next at 249288710425ns, rc = 0 00000100:00100000:3.0:1789427903.794748:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940086656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427903.794817:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427903.794946:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086656 00000100:00100000:2.0:1789427903.794955:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086656 00000100:00100000:2.0:1789427903.795020:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789427903.795033:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940086656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427903.795074:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789427903.795127:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940086656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427903.795149:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789427903.795308:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940086656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427903.796141:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427903.796155:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195844a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940086784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427903.796212:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427903.797669:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086784 00000100:00100000:1.0:1789427903.797681:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086784 00000100:00100000:1.0:1789427903.797733:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789427903.797744:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940086784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427903.797768:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789427903.797841:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940086784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427903.797847:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789427903.798107:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195844a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940086784:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427903.926117:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789427904.306382:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1789427904.949755:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427904.949803:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940086912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427904.949956:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427904.950092:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940086912 00000100:00100000:3.0:1789427904.950102:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940086912 00000100:00100000:3.0:1789427904.950153:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789427904.950162:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940086912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427904.950206:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789427904.950261:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940086912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427904.950270:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789427904.950325:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940086912:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1789427905.332144:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789427905.332199:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1789427905.332228:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff919698c8d900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789427905.332265:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837fad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff919698c8df00 00000020:00080000:3.0:1789427905.332269:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9195837fa900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919584478200 00000020:00080000:3.0:1789427905.332287:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1789427905.332446:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427905.332471:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940087040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427905.332567:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427905.332653:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087040 00000100:00100000:2.0:1789427905.332663:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087040 00000100:00100000:2.0:1789427905.332733:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789427905.332746:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940087040:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789427905.332999:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427905.333130:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333143:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333152:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333158:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427905.333164:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333171:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333191:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff919698406700) 00010000:00010000:0.0:1789427905.333194:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427905.333200:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427905.333205:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518c69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427905.333309:0:8902:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789427905.333313:0:8902:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789427898 -> 1789427898 00002000:00010000:2.0:1789427905.333316:0:8902:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1789427898 -> 1789427898 00002000:00010000:2.0:1789427905.333318:0:8902:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789427898 -> 1789427898 00002000:00010000:2.0:1789427905.333320:0:8902:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000020:00080000:1.0:1789427905.333932:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789427905.334004:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789427905.334115:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350940087040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1369us (1544us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789427905.334125:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000001:00080000:0.0:1789427905.334366:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789427905.334374:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:3.0:1789427905.334667:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91958444e300/2, rc 0, transno 4294967313 00000100:00100000:3.0:1789427905.334675:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940087040:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789427905.968631:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427906.993665:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427907.381626:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427907.381647:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940087168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427907.385007:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427907.385837:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087168 00000100:00100000:0.0:1789427907.385853:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087168 00000100:00100000:0.0:1789427907.385921:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789427907.385944:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940087168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789427907.385981:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789427907.386380:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940087168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 439us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427907.386389:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789427907.387945:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940087168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427907.566234:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566272:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566301:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566325:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566355:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566371:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566404:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427907.566461:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639040 00000100:00100000:0.0:1789427907.566470:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639040 00000100:00100000:0.0:1789427907.566520:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639168 00000100:00100000:0.0:1789427907.566523:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639168 00000100:00100000:0.0:1789427907.566541:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:0.0:1789427907.566551:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931639040:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427907.566614:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931639040:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427907.566621:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:0.0:1789427907.566635:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:0.0:1789427907.566641:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931639168:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427907.566660:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931639168:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 20us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427907.566676:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00080000:0.0:1789427907.566695:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427907.566699:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427907.566938:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638656 00000100:00100000:2.0:1789427907.566943:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638656 00000100:00100000:2.0:1789427907.566982:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 378 00000100:00100000:2.0:1789427907.566989:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931638656:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427907.567019:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2397:x1876350931638656:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.567025:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 378 00000100:00100000:2.0:1789427907.567053:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638784 00000100:00100000:2.0:1789427907.567056:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638784 00000100:00100000:2.0:1789427907.567090:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931638912 00000100:00100000:2.0:1789427907.567093:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931638912 00000100:00100000:2.0:1789427907.567106:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639296 00000100:00100000:2.0:1789427907.567109:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639296 00000100:00100000:2.0:1789427907.567119:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639424 00000100:00100000:2.0:1789427907.567121:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639424 00000100:00100000:2.0:1789427907.567133:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 285 00000100:00100000:2.0:1789427907.567139:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+13:2397:x1876350931638784:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427907.567166:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+13:2397:x1876350931638784:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.567172:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 285 00000100:00100000:2.0:1789427907.567185:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:2.0:1789427907.567191:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931638912:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427907.567211:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2397:x1876350931638912:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.567217:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:2.0:1789427907.567229:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 287 00000100:00100000:2.0:1789427907.567234:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931639296:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427907.567256:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931639296:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.567262:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 287 00000100:00100000:2.0:1789427907.567274:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00100000:2.0:1789427907.567281:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931639424:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427907.567303:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2397:x1876350931639424:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.567317:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00080000:0.0:1789427907.568131:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427907.568135:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427907.889503:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940087424:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889567:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889619:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940087936:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889639:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889654:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940088448:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889670:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889696:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789427907.889702:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940087296:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889729:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889747:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940087808:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889770:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889784:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088320:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889806:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.889823:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088832:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.889842:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427907.889956:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087296 00000100:00100000:1.0:1789427907.889964:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087296 00000100:00100000:1.0:1789427907.890008:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789427907.890017:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940087296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890060:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940087296:12345-0@lo:400:kworker.0 Request processed in 45us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.890067:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789427907.890099:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087808 00000100:00100000:1.0:1789427907.890103:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087808 00000100:00100000:1.0:1789427907.890142:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789427907.890148:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940087808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890183:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940087808:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.890188:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789427907.890227:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427907.890250:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427907.890279:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940087296:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890289:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940087808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890314:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088960 00000100:00100000:1.0:1789427907.890317:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088960 00000100:00100000:1.0:1789427907.890348:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789427907.890354:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940088960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427907.890376:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427907.890411:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940088960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.890435:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789427907.890453:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427907.890468:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789427907.890473:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789427907.890489:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9196bfacca80, transno 4294967305 00000100:00100000:1.0:1789427907.890505:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427907.890524:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940087552:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890546:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427907.890565:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940088064:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890596:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427907.890613:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940088576:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.890631:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.891358:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940087680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891396:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.891411:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940088192:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891443:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.891458:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940088704:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891486:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.891515:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087424 00000100:00100000:3.0:1789427907.891520:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087424 00000100:00100000:3.0:1789427907.891542:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087936 00000100:00100000:3.0:1789427907.891545:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087936 00000100:00100000:3.0:1789427907.891564:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088448 00000100:00100000:3.0:1789427907.891567:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088448 00000100:00100000:3.0:1789427907.891577:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088064 00000100:00100000:3.0:1789427907.891579:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088064 00000100:00100000:3.0:1789427907.891590:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088576 00000100:00100000:3.0:1789427907.891592:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088576 00000100:00100000:3.0:1789427907.891602:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087680 00000100:00100000:3.0:1789427907.891604:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087680 00000100:00100000:3.0:1789427907.891616:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789427907.891622:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940087424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891660:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940087424:12345-0@lo:400:kworker.0 Request processed in 38us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427907.891667:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789427907.891680:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789427907.891686:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940087936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891712:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940087936:12345-0@lo:400:kworker.0 Request processed in 27us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427907.891718:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789427907.891729:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789427907.891735:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940088448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891763:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940088448:12345-0@lo:400:kworker.0 Request processed in 29us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427907.891768:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789427907.891791:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789427907.891797:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940088064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.891832:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940088064:12345-0@lo:400:kworker.0 Request processed in 35us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427907.891837:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789427907.891851:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789427907.891856:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940088576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892291:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940087552 00000100:00100000:1.0:1789427907.892298:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940087552 00000100:00100000:1.0:1789427907.892330:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789427907.892336:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940087552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892374:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940087552:12345-0@lo:400:kworker.0 Request processed in 39us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.892380:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789427907.892406:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789427907.892429:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940087680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892465:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940087680:12345-0@lo:400:kworker.0 Request processed in 52us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.892471:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1789427907.892493:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427907.892497:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427907.892524:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940087680:0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892660:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088320 00000100:00100000:1.0:1789427907.892665:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088320 00000100:00100000:1.0:1789427907.892696:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088832 00000100:00100000:1.0:1789427907.892700:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088832 00000100:00100000:1.0:1789427907.892712:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088192 00000100:00100000:1.0:1789427907.892715:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088192 00000100:00100000:1.0:1789427907.892726:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940088704 00000100:00100000:1.0:1789427907.892729:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940088704 00000100:00100000:1.0:1789427907.892743:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789427907.892749:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940088320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892792:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940088320:12345-0@lo:400:kworker.0 Request processed in 42us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.892798:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789427907.892811:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427907.892817:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.892843:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940088832:12345-0@lo:400:kworker.0 Request processed in 27us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.892850:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427907.892861:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789427907.893352:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789427907.893362:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940088704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893406:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940088704:12345-0@lo:400:kworker.0 Request processed in 46us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427907.893411:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789427907.893474:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940088704:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893514:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789427907.893519:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789427907.893537:0:3616:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91958444e300 x1876350940087040/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789427921 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427907.893547:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088320:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893557:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940088832:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893567:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940087424:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893577:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940087936:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.893586:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940088448:0@lo:400:kworker.0 00000100:00080000:0.0:1789427907.893614:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427907.893616:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427907.893647:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940087552:0@lo:400:kworker.0 00010000:00080000:0.0:1789427907.893668:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad929880 x1876350940088064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427907.893678:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940088064:0@lo:400:kworker.0 00000100:00100000:3.0:1789427907.894304:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940088576:12345-0@lo:400:kworker.0 Request processed in 2446us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427907.894312:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789427907.894442:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940088192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427907.894489:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940088192:12345-0@lo:400:kworker.0 Request processed in 1622us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427907.894495:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:0.0:1789427907.894647:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad928380 x1876350940088576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427907.894658:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940088576:0@lo:400:kworker.0 00000100:00100000:0.0:1789427907.895132:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427907.895174:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427907.895354:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940088192:0@lo:400:kworker.0 00000100:00100000:2.0:1789427907.895436:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089088 00000100:00100000:2.0:1789427907.895443:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089088 00000100:00100000:2.0:1789427907.895489:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789427907.895497:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940089088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427907.895514:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427907.895566:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427907.895572:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789427907.896966:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940089088:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789427908.019099:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427908.914463:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427908.914486:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940089216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427908.914549:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427908.914674:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089216 00000100:00100000:1.0:1789427908.914682:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089216 00000100:00100000:1.0:1789427908.914741:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789427908.914750:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195844a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940089216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427908.914779:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789427908.915184:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195844a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940089216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427908.915192:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789427908.915510:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940089216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427908.915611:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940089344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427908.915642:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427908.915743:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089344 00000100:00100000:3.0:1789427908.915749:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089344 00000100:00100000:3.0:1789427908.915786:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427908.915794:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940089344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789427908.915807:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789427908.915851:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940089344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427908.915867:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789427908.915973:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940089344:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789427909.048004:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427910.064647:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427910.332036:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427910.335076:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639552 00000100:00100000:1.0:1789427910.335092:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639552 00000100:00100000:1.0:1789427910.335253:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:1.0:1789427910.335267:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+13:11055:x1876350931639552:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789427910.335406:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+13:11055:x1876350931639552:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 144us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427910.335433:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00080000:0.0:1789427910.338475:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427910.343030:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427910.343115:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639680 00000100:00100000:2.0:1789427910.343125:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639680 00000100:00100000:2.0:1789427910.343205:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:2.0:1789427910.343216:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:11055:x1876350931639680:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789427910.343329:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:11055:x1876350931639680:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427910.343337:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00080000:0.0:1789427910.344707:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427910.350279:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427910.362361:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931639936 00000100:00100000:0.0:1789427910.362380:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931639936 00000100:00100000:0.0:1789427910.362494:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:0.0:1789427910.362506:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+13:11055:x1876350931639936:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427910.363702:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:11055:x1876350931639936:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1191us (13425us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789427910.363712:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000001:00080000:3.0:1789427910.393230:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1789427910.393248:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789427910.393324:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789427910.393336:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789427910.450306:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940089472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427910.450387:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427910.450597:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089472 00000100:00100000:2.0:1789427910.450607:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089472 00000100:00100000:2.0:1789427910.450672:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789427910.450682:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940089472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789427910.450717:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789427910.450776:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940089472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427910.450784:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789427910.450937:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940089472:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789427911.092216:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789427911.474995:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000040:00080000:1.0:1789427912.024802:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427912.024813:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427912.025310:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789427912.025319:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789427912.114069:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427912.123701:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789427912.500058:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427912.500088:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940089600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427912.500506:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427912.500646:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089600 00000100:00100000:1.0:1789427912.500658:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089600 00000100:00100000:1.0:1789427912.500729:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789427912.500742:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940089600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427912.500787:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427912.500858:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940089600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427912.500865:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789427912.501557:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940089600:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789427912.621234:0:14521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:18:30 (1789427910) 00000100:00100000:0.0:1789427912.685321:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685378:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685406:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685469:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685494:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685522:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685557:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427912.685607:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640192 00000100:00100000:0.0:1789427912.685620:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640192 00000100:00100000:0.0:1789427912.685694:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640704 00000100:00100000:0.0:1789427912.685697:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640704 00000100:00100000:0.0:1789427912.685711:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640320 00000100:00100000:0.0:1789427912.685713:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640320 00000100:00100000:0.0:1789427912.685729:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640832 00000100:00100000:0.0:1789427912.685732:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640832 00000100:00100000:0.0:1789427912.685763:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 295 00000100:00100000:0.0:1789427912.685776:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+13:2394:x1876350931640192:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.685920:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+13:2394:x1876350931640192:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 147us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.685951:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 295 00000100:00100000:0.0:1789427912.686144:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:0.0:1789427912.686153:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931640704:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686182:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931640704:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686189:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:0.0:1789427912.686202:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 297 00000100:00100000:0.0:1789427912.686209:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931640320:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686261:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931640320:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 51us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686267:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 297 00000100:00100000:0.0:1789427912.686282:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 298 00000100:00100000:0.0:1789427912.686288:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931640832:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686314:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931640832:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686320:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 298 00000100:00100000:0.0:1789427912.686342:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640064 00000100:00100000:0.0:1789427912.686347:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640064 00000100:00100000:0.0:1789427912.686373:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 380 00000100:00100000:0.0:1789427912.686379:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931640064:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686401:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931640064:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 23us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686407:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 380 00000100:00100000:0.0:1789427912.686493:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640448 00000100:00100000:0.0:1789427912.686499:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640448 00000100:00100000:0.0:1789427912.686530:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931640576 00000100:00100000:0.0:1789427912.686533:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931640576 00000100:00100000:0.0:1789427912.686551:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:0.0:1789427912.686558:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931640448:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686585:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2394:x1876350931640448:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686591:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:0.0:1789427912.686603:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:0.0:1789427912.686609:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931640576:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427912.686632:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931640576:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.686637:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00080000:0.0:1789427912.686658:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427912.686663:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427912.686665:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427912.686668:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427913.008720:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427913.008750:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940089728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427913.008867:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.009007:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089728 00000100:00100000:1.0:1789427913.009018:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089728 00000100:00100000:1.0:1789427913.009094:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789427913.009106:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940089728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427913.009145:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427913.009202:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940089728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.009209:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789427913.009276:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940089728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427913.009902:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940089984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.009949:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.009974:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940090496:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.009998:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010015:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940091008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010035:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010063:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789427913.010070:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940089856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010101:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010122:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940090368:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010149:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010168:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940090880:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010192:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010218:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940090240:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010258:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010277:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940090752:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010300:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010316:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940091264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010337:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010357:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789427913.010362:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940090112:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010404:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010456:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940090624:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010479:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010502:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940091136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010521:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.010543:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089856 00000100:00100000:1.0:1789427913.010550:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089856 00000100:00100000:1.0:1789427913.010587:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789427913.010595:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940089856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010640:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a2119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940089856:12345-0@lo:400:kworker.0 Request processed in 45us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.010647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789427913.010683:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090368 00000100:00100000:1.0:1789427913.010687:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090368 00000100:00100000:1.0:1789427913.010708:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090112 00000100:00100000:1.0:1789427913.010710:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090112 00000100:00100000:1.0:1789427913.010724:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427913.010730:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940090368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010763:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940090368:12345-0@lo:400:kworker.0 Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.010769:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427913.010780:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789427913.010786:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010813:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940090112:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.010831:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789427913.010851:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090880 00000100:00100000:1.0:1789427913.010854:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090880 00000100:00100000:1.0:1789427913.010881:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090752 00000100:00100000:1.0:1789427913.010884:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090752 00000100:00100000:1.0:1789427913.010900:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091264 00000100:00100000:1.0:1789427913.010910:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091264 00000100:00100000:1.0:1789427913.010931:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427913.010936:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940090880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.010967:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940090880:12345-0@lo:400:kworker.0 Request processed in 31us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.010974:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789427913.010985:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789427913.010990:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940090752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011013:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940090752:12345-0@lo:400:kworker.0 Request processed in 23us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.011018:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789427913.011028:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789427913.011034:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940091264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011056:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940091264:12345-0@lo:400:kworker.0 Request processed in 22us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.011061:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789427913.011106:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940090112:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011116:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940090752:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011125:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940091264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011158:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940089856:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011167:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940090368:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.011176:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789427913.011183:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91958444e300, transno 4294967313 00000100:00100000:1.0:1789427913.011198:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfacc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940090880:0@lo:400:kworker.0 00000100:00080000:0.0:1789427913.011475:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427913.011481:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427913.011498:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940089984 00000100:00100000:0.0:1789427913.011503:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940089984 00000100:00100000:0.0:1789427913.011530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090496 00000100:00100000:0.0:1789427913.011533:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090496 00000100:00100000:0.0:1789427913.011561:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091008 00000100:00100000:0.0:1789427913.011565:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091008 00000100:00100000:0.0:1789427913.011578:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090240 00000100:00100000:0.0:1789427913.011581:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090240 00000100:00100000:0.0:1789427913.011593:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940090624 00000100:00100000:0.0:1789427913.011603:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940090624 00000100:00100000:0.0:1789427913.011628:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091136 00000100:00100000:0.0:1789427913.011631:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091136 00000100:00100000:0.0:1789427913.011649:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789427913.011656:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940089984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011700:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940089984:12345-0@lo:400:kworker.0 Request processed in 44us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011706:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789427913.011721:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789427913.011726:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011752:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940090496:12345-0@lo:400:kworker.0 Request processed in 26us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011757:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789427913.011768:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789427913.011773:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940091008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011795:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940091008:12345-0@lo:400:kworker.0 Request processed in 22us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011800:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789427913.011810:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789427913.011816:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940090240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011856:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940090240:12345-0@lo:400:kworker.0 Request processed in 40us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011862:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789427913.011874:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789427913.011879:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011905:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940090624:12345-0@lo:400:kworker.0 Request processed in 26us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011917:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789427913.011930:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789427913.011935:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940091136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427913.011964:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940091136:12345-0@lo:400:kworker.0 Request processed in 29us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.011970:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1789427913.013476:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427913.013486:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789427913.013544:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958444a300 x1876350940090624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427913.013562:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940090624:0@lo:400:kworker.0 00010000:00080000:1.0:1789427913.013579:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29f80 x1876350940091136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427913.013588:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940091136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.013602:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940090240:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.013651:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940089984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.013665:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940090496:0@lo:400:kworker.0 00000100:00100000:1.0:1789427913.013676:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bface300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940091008:0@lo:400:kworker.0 00000100:00100000:3.0:1789427913.014750:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940091392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427913.014833:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427913.014964:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091392 00000100:00100000:2.0:1789427913.014972:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091392 00000100:00100000:2.0:1789427913.015027:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789427913.015037:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940091392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427913.015062:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427913.015157:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940091392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427913.015165:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789427913.020065:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940091392:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789427913.137853:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427913.661359:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427913.661594:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641088 00000100:00100000:0.0:1789427913.661607:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641088 00000100:00100000:0.0:1789427913.661766:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:0.0:1789427913.661780:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+13:12129:x1876350931641088:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427913.661809:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427913.661867:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518cf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d0c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.661976:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.661998:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662015:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662034:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662041:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662072:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662232:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518d0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662242:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662251:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427913.662263:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789427913.662378:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662387:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662396:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662403:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427913.662408:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662467:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662482:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919581d4e900) 00010000:00010000:0.0:1789427913.662486:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427913.662511:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662519:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518cfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662536:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662543:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662549:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662555:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427913.662558:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662564:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662573:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91958354da00) 00010000:00010000:0.0:1789427913.662575:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427913.662579:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.662585:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede518d03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.663080:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518cf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d0c expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.663110:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d0c expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427913.663117:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:0.0:1789427913.663120:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427913.663123:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f800, rc 0) 00000100:00100000:0.0:1789427913.663355:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+15:12129:x1876350931641088:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1576us (2009us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789427913.663365:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:3.0:1789427913.674112:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427913.674279:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427913.674655:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641344 00000100:00100000:2.0:1789427913.674668:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641344 00000100:00100000:2.0:1789427913.674764:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789427913.674776:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+15:2397:x1876350931641344:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427913.674796:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427913.674841:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518d0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d0c expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427913.674866:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427913.674883:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427913.674977:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:2397:x1876350931641344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 203us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427913.674985:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1789427913.676270:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641216 00000100:00100000:0.0:1789427913.676285:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641216 00000100:00100000:0.0:1789427913.676412:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:0.0:1789427913.676441:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:12129:x1876350931641216:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789427913.676587:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:12129:x1876350931641216:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 149us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.676595:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:3.0:1789427913.679115:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427913.679297:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641472 00000100:00100000:0.0:1789427913.679310:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641472 00000100:00100000:0.0:1789427913.679379:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00100000:0.0:1789427913.679647:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:12129:x1876350931641472:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789427913.679844:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:12129:x1876350931641472:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 454us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427913.679853:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00100000:3.0:1789427914.032767:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427914.032799:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940091520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427914.032921:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427914.033016:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091520 00000100:00100000:3.0:1789427914.033028:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091520 00000100:00100000:3.0:1789427914.033096:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427914.033108:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940091520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427914.033151:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789427914.033210:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940091520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427914.033218:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427914.033281:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940091520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427914.035823:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a9808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940091648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427914.035950:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427914.037728:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091648 00000100:00100000:3.0:1789427914.038669:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091648 00000100:00100000:3.0:1789427914.039207:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789427914.039223:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940091648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789427914.039260:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789427914.039363:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940091648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427914.039371:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789427914.040377:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a9808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940091648:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789427914.160945:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427914.164795:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789427914.208362:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427914.208373:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427914.209170:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1789427914.209185:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789427915.194891:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427915.573264:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427915.573288:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940091776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427915.573360:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427915.573743:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940091776 00000100:00100000:1.0:1789427915.573752:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940091776 00000100:00100000:1.0:1789427915.574874:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427915.574892:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a9808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940091776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427915.574929:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789427915.575005:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a9808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940091776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427915.575012:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427915.575072:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940091776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427916.095566:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.095657:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641600 00000100:00100000:1.0:1789427916.095667:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641600 00000100:00100000:1.0:1789427916.095741:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00100000:1.0:1789427916.095751:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+14:12171:x1876350931641600:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427916.095770:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.095800:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d13 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095869:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095884:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095898:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095912:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095919:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095926:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095964:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095971:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095990:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.095996:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427916.096001:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096009:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096020:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:1.0:1789427916.096024:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.096028:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096035:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096046:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096052:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096058:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096063:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427916.096066:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096080:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096087:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919581d4e400) 00010000:00010000:1.0:1789427916.096090:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.096093:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096099:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096126:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d13 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096136:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:1.0:1789427916.096663:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.096669:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d13 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.096682:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46c00, rc 0) 00000100:00100000:1.0:1789427916.096752:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+14:12171:x1876350931641600:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1002us (1195us total) trans 0 rc 301/301 00000100:00100000:1.0:1789427916.096760:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00080000:2.0:1789427916.096968:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427916.102191:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.102268:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641856 00000100:00100000:1.0:1789427916.102277:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641856 00000100:00100000:1.0:1789427916.102335:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 153 00000100:00100000:1.0:1789427916.102345:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:12171:x1876350931641856:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:1.0:1789427916.102442:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427916.102466:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b800/0x84fc867ede51867a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b3e expref: 14 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102487:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f600) 00010000:00010000:1.0:1789427916.102496:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427916.102546:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102559:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102569:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102580:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102588:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.102594:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103238:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103249:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103257:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427916.103276:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a8eb7bf reply state 00000000c68ab2f1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103287:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103294:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427916.103296:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427916.103299:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789427916.103303:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789427916.103309:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103317:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103324:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103331:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427916.103335:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103342:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103349:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919581d4e600) 00010000:00010000:1.0:1789427916.103352:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.103355:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.103369:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427916.104818:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a8eb7bf reply state 00000000c68ab2f1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.104836:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.104852:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919581d4e500) 00010000:00010000:1.0:1789427916.104855:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427916.104858:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789427916.104941:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+15:12171:x1876350931641856:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 2595us (2757us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789427916.104949:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 153 00010000:00010000:0.0:1789427916.209073:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427916.341138:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.341227:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931641984 00000100:00100000:3.0:1789427916.341237:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931641984 00000100:00100000:3.0:1789427916.342940:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 154 00000100:00100000:3.0:1789427916.342959:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+15:12179:x1876350931641984:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:3.0:1789427916.342985:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427916.343010:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d1a expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343070:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343096:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343108:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427916.343153:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789427916.343157:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427916.343176:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343199:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d1a expref: 17 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343219:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d1a expref: 16 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.343228:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427916.343231:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427916.343234:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209200, rc 0) 00000100:00100000:3.0:1789427916.343342:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+16:12179:x1876350931641984:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 391us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427916.343349:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 154 00000100:00100000:3.0:1789427916.520957:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427916.521131:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931642112 00000100:00100000:2.0:1789427916.521148:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931642112 00000100:00100000:2.0:1789427916.521212:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:2.0:1789427916.521223:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+16:12185:x1876350931642112:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427916.521244:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427916.521265:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d21 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521329:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521343:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521356:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521367:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521375:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521382:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521485:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521494:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521501:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427916.521540:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789427916.521543:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427916.521561:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521573:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521580:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521587:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521592:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427916.521597:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521604:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521615:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:2.0:1789427916.521617:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427916.521622:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521628:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521640:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521655:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521661:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521667:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427916.521670:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521676:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521683:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919581d4e500) 00010000:00010000:2.0:1789427916.521685:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427916.521688:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521694:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518d5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521720:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d21 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521734:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d21 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.521742:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427916.521744:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789427916.521752:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789427916.521830:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+17:12185:x1876350931642112:12345-192.168.202.24@tcp:101:bash.0 Request processed in 608us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427916.521938:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:0.0:1789427916.534409:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.534524:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931642368 00000100:00100000:1.0:1789427916.534533:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931642368 00000100:00100000:1.0:1789427916.534591:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:1.0:1789427916.534600:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+17:12185:x1876350931642368:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1789427916.534620:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.534639:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d28 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534751:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534766:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534807:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534869:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534878:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.534885:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427916.535186:0:6482:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789427916.535407:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535446:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535454:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535489:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535497:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535504:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535510:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427916.535522:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535531:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535542:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427916.535545:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.535550:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535557:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518d73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427916.535570:0:6482:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006486935c reply state 00000000490887d6 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535580:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535586:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e600) 00010000:00010000:1.0:1789427916.535589:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427916.535591:0:6482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789427916.535618:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede518d6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535631:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.535638:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:1.0:1789427916.535641:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427916.535650:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46000, rc 0) 00000100:00100000:1.0:1789427916.535945:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+20:12185:x1876350931642368:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1344us (1542us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789427916.535953:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:3.0:1789427916.548595:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.549381:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931642496 00000100:00100000:1.0:1789427916.549392:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931642496 00000100:00100000:1.0:1789427916.549514:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1789427916.549529:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931642496:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1789427916.549546:0:8902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.549566:0:8902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d2f expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427916.549590:0:8902:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789427916.549608:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=261s v=(0 0) 00010000:00010000:1.0:1789427916.549613:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427916.549622:0:8902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 6 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.549641:0:8902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 6 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.549654:0:8902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46e00, rc 0) 00000100:00100000:1.0:1789427916.549713:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931642496:12345-192.168.202.24@tcp:101:bash.0 Request processed in 183us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.549724:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00080000:2.0:1789427916.549821:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427916.554241:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.554325:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931642624 00000100:00100000:1.0:1789427916.554341:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931642624 00000100:00100000:1.0:1789427916.554442:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1789427916.554452:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+6:12185:x1876350931642624:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1789427916.554470:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.554488:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d36 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.554520:0:8400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 7 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.554530:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427916.554534:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427916.554539:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.554570:0:8400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 7 pid: 8902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.554582:0:8400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 7 pid: 8902 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427916.554595:0:8400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195847bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8400:1876350940091904:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427916.554693:0:8400:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427916.557373:0:8400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195847bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8400:1876350940091904:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427916.557888:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.557999:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931642752 00000100:00100000:0.0:1789427916.558006:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931642752 00010000:00010000:0.0:1789427916.558044:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 8 pid: 8902 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.558090:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:0.0:1789427916.558099:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931642752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427916.558112:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427916.558134:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 8 pid: 8902 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.558146:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 8 pid: 8902 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.558169:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acb12e0d/0x84fc867ede518d8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d2f expref: 8 pid: 8902 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.558328:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427916.558332:0:7887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427916.558341:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.558367:0:7887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.558400:0:7887:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.558816:0:7887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583709180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7887:1876350940092032:192.168.202.24@tcp:105: 00000100:00100000:0.0:1789427916.558949:0:7887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5780 going to sleep for 11 seconds 00010000:00010000:1.0:1789427916.559013:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.559039:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46c00, rc 0) 00000100:00100000:1.0:1789427916.559073:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:12185:x1876350931642624:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4623us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.559084:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:0.0:1789427916.562205:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.562729:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931643008 00000100:00100000:3.0:1789427916.562754:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931643008 00000100:00100000:2.0:1789427916.562779:0:7887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583709180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7887:1876350940092032:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789427916.562811:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427916.562816:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1789427916.562825:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:12185:x1876350931643008:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1789427916.562889:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2397:x1876350931642752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4791us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427916.562897:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:3.0:1789427916.563080:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:12185:x1876350931643008:12345-192.168.202.24@tcp:35:bash.0 Request processed in 256us (887us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789427916.563087:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1789427916.677802:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.678262:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931643264 00000100:00100000:0.0:1789427916.678271:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931643264 00000100:00100000:0.0:1789427916.678375:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:0.0:1789427916.678385:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+21:12195:x1876350931643264:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427916.678409:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427916.678481:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d3d expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427916.678574:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789427916.678662:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518d9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d3d expref: 23 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.678676:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:0.0:1789427916.678679:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427916.678684:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d3d expref: 23 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.678716:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fc00, rc 0) 00000100:00100000:0.0:1789427916.679007:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:12195:x1876350931643264:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 623us (1224us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789427916.679015:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:1.0:1789427916.682072:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.682310:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931643520 00000100:00100000:3.0:1789427916.682319:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931643520 00000100:00100000:3.0:1789427916.682364:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:3.0:1789427916.682372:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:12195:x1876350931643520:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1789427916.682631:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+23:12195:x1876350931643520:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 258us (565us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789427916.682638:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1789427916.755526:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.755611:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931643648 00000100:00100000:0.0:1789427916.755620:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931643648 00000100:00100000:0.0:1789427916.755682:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:0.0:1789427916.755692:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+23:12201:x1876350931643648:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427916.755724:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427916.755744:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d44 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.755848:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.755863:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.755874:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427916.755916:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789427916.755920:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427916.755936:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.755961:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d44 expref: 25 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.756000:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d44 expref: 24 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.756008:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427916.756012:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427916.756015:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f600, rc 0) 00000100:00100000:0.0:1789427916.756076:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+24:12201:x1876350931643648:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 385us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427916.756083:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:1.0:1789427916.763054:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.763161:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931643904 00000100:00100000:0.0:1789427916.763171:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931643904 00000100:00100000:0.0:1789427916.763232:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:0.0:1789427916.763242:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:12201:x1876350931643904:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427916.763260:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427916.763280:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518db9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d4b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.763379:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518dc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.763393:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.763405:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427916.763445:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789427916.763564:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518db9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d4b expref: 27 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.763583:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d4b expref: 26 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.763592:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:0.0:1789427916.763595:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427916.763598:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fa00, rc 0) 00000100:00100000:0.0:1789427916.763658:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+26:12201:x1876350931643904:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 416us (612us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789427916.763665:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:3.0:1789427916.768096:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.768152:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.768226:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644160 00000100:00100000:0.0:1789427916.768235:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644160 00000100:00100000:0.0:1789427916.768294:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00100000:0.0:1789427916.768304:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+26:12201:x1876350931644160:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427916.768326:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427916.768344:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518dce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d52 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.768465:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.768479:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.768491:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427916.768520:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789427916.768611:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518dce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d52 expref: 29 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.768629:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d52 expref: 28 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.768638:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:0.0:1789427916.768640:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789427916.768644:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e000, rc 0) 00000100:00100000:0.0:1789427916.768839:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+28:12201:x1876350931644160:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 535us (750us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789427916.768857:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00100000:1.0:1789427916.769096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644288 00000100:00100000:1.0:1789427916.769102:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644288 00000100:00100000:1.0:1789427916.769154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1789427916.769162:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+28:2396:x1876350931644288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427916.769171:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427916.769184:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518dc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d4b expref: 28 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.769196:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:1.0:1789427916.769199:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427916.769219:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+27:2396:x1876350931644288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.769225:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1789427916.780181:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.781024:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644416 00000100:00100000:0.0:1789427916.781036:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644416 00000100:00100000:0.0:1789427916.781137:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:0.0:1789427916.781147:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+6:2395:x1876350931644416:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:0.0:1789427916.781190:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.781211:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 6 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.781221:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427916.781225:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427916.781230:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.781276:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 6 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.781290:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 6 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.781305:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958370bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8402:1876350940092160:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427916.781404:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427916.804560:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427916.804686:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644544 00000100:00100000:2.0:1789427916.804696:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644544 00002000:00100000:2.0:1789427916.804753:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff919583fc0000 x1876350931644544/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:162/0 lens 504/0 e 0 to 0 dl 1789427927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427916.804766:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919583fc0000 with x1876350931644544 ext(0->12) 00010000:00010000:2.0:1789427916.804776:0:8406:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.804805:0:8406:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 7 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427916.804814:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919583fc0000 00000100:00100000:2.0:1789427916.804859:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1789427916.804869:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931644544:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:2.0:1789427916.806411:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931644544:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 1538us (1855us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789427916.806454:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00002000:00100000:2.0:1789427916.806466:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff919583fc0000 x1876350931644544/t4294967306(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:162/0 lens 504/448 e 0 to 0 dl 1789427927 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427916.806475:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919583fc0000 with x1876350931644544 ext(0->12) 00010000:00010000:2.0:1789427916.806483:0:8406:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.806500:0:8406:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427916.806508:0:8406:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919583fc0000 00000100:00100000:0.0:1789427916.807317:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958370bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8402:1876350940092160:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427916.807341:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427916.809767:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.810440:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644672 00000100:00100000:0.0:1789427916.810460:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644672 00010000:00010000:0.0:1789427916.810500:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.810534:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:0.0:1789427916.810543:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:2396:x1876350931644672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427916.810559:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789427916.810576:0:6469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789427916.810579:0:6469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789427916 00002000:00010000:0.0:1789427916.810582:0:6469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789427916 00002000:00010000:0.0:1789427916.810585:0:6469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789427916 00002000:00010000:0.0:1789427916.810598:0:6469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789427916.810606:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.810625:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.810648:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f660114/0x84fc867ede518d96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d36 expref: 9 pid: 8400 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.810664:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427916.810668:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427916.810674:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.810685:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427916.810709:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427916.810759:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931644672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 217us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427916.810766:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00010000:00010000:1.0:1789427916.813449:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813491:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813524:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813532:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813541:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813548:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427916.813552:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813562:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813580:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.813588:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede518de3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427916.813705:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2395:x1876350931644416:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 32556us (33529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.813715:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1789427916.816259:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.816349:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931644928 00000100:00100000:3.0:1789427916.816362:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931644928 00000100:00100000:3.0:1789427916.816549:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1789427916.816561:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:12201:x1876350931644928:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:3.0:1789427916.816664:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d52 expref: 27 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427916.816941:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789427916.816976:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789427916.817342:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1789427916.817383:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.817400:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 31 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.817411:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.817484:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 31 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.817501:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 31 pid: 6482 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427916.817518:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940092288:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427916.817637:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682f64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427916.820566:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427916.820682:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931645056 00000100:00100000:2.0:1789427916.820697:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931645056 00000100:00100000:3.0:1789427916.820830:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940092288:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427916.820859:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.820937:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 32 pid: 6482 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427916.820985:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:2.0:1789427916.820996:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+32:2397:x1876350931645056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427916.821012:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427916.821020:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 32 pid: 6482 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821034:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 32 pid: 6482 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821056:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518d81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d28 expref: 32 pid: 6482 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821087:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:2.0:1789427916.821093:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821103:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821111:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.821168:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.821178:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.821280:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1789427916.821366:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789427916.821467:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+32:2397:x1876350931645056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 471us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427916.821478:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000001:00080000:3.0:1789427916.822047:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789427916.822163:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940092416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789427916.822218:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427916.822294:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427916.822966:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940092416 00000100:00100000:0.0:1789427916.822976:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940092416 00000100:00100000:0.0:1789427916.823142:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789427916.823153:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940092416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427916.823298:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940092416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427916.823305:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789427916.823338:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427916.823404:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940092416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789427916.823576:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789427916.823635:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940092544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789427916.823679:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427916.823993:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196984f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789427916.824054:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940092544 00000100:00100000:1.0:1789427916.824060:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940092544 00000100:00100000:1.0:1789427916.824086:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789427916.824094:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1876350940092544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789427916.824223:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6486:x1876350940092544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (543us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789427916.824230:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789427916.824306:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940092544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789427916.824352:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789427916.824388:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824400:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824409:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824446:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427916.824452:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824461:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824481:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:3.0:1789427916.824485:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789427916.824493:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.824511:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518dea lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427916.824621:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789427916.824823:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789427916.824836:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 261319420640ns, next at 262319418076ns, rc = 0 00000001:00080000:3.0:1789427916.824896:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789427916.824919:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4e400) 00010000:00010000:3.0:1789427916.824922:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789427916.824929:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518dd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d52 expref: 35 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427916.825038:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+34:12201:x1876350931644928:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 8480us (8791us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789427916.825046:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000020:00080000:3.0:1789427916.825051:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789427916.829570:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427916.829765:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931645184 00000100:00100000:1.0:1789427916.829777:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931645184 00000100:00100000:1.0:1789427916.829878:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:1.0:1789427916.829892:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+34:12201:x1876350931645184:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427916.829924:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.829956:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518df1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d59 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.830031:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d59 expref: 35 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.830050:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d59 expref: 35 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.830100:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:1.0:1789427916.830103:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789427916.830108:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46a00, rc 0) 00000100:00100000:1.0:1789427916.830294:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+35:12201:x1876350931645184:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 405us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.830302:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:1.0:1789427916.833704:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.833795:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931645440 00000100:00100000:0.0:1789427916.833806:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931645440 00000100:00100000:0.0:1789427916.833873:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:0.0:1789427916.833884:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+35:12201:x1876350931645440:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427916.834163:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+36:12201:x1876350931645440:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 281us (473us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789427916.834170:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1789427916.936197:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427916.936405:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931645696 00000100:00100000:2.0:1789427916.936523:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931645696 00000100:00100000:2.0:1789427916.936683:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 162 00000100:00100000:2.0:1789427916.936698:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+36:12211:x1876350931645696:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427916.936743:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427916.936772:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d60 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427916.936997:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789427916.937247:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518df8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d60 expref: 38 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.937291:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:2.0:1789427916.937295:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427916.937303:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d60 expref: 38 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.937322:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427916.938101:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+37:12211:x1876350931645696:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1401us (1912us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789427916.938111:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 162 00000100:00100000:0.0:1789427916.941107:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427916.941215:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931645824 00000100:00100000:3.0:1789427916.941227:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931645824 00000100:00100000:3.0:1789427916.941287:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:3.0:1789427916.941298:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:12211:x1876350931645824:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1789427916.941392:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.941509:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.941527:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.941559:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.941568:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.941575:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942114:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942126:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942133:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427916.942278:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942294:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942300:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942307:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942313:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427916.942318:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942334:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942349:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427916.942352:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427916.942357:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942363:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942381:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942387:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942392:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942397:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427916.942400:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942405:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942565:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e600) 00010000:00010000:3.0:1789427916.942567:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427916.942570:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942582:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942595:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942599:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942603:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942606:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427916.942608:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942611:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942615:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427916.942616:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427916.942618:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.942622:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427916.943272:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:12211:x1876350931645824:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1967us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427916.943284:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:3.0:1789427916.947345:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427916.947882:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931646080 00000100:00100000:0.0:1789427916.947897:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931646080 00000100:00100000:0.0:1789427916.948256:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:0.0:1789427916.948269:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+37:12211:x1876350931646080:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427916.948919:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+38:12211:x1876350931646080:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 651us (1586us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789427916.948929:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:1.0:1789427916.996550:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427916.997172:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931646336 00000100:00100000:2.0:1789427916.997186:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931646336 00000100:00100000:2.0:1789427916.997337:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00100000:2.0:1789427916.997352:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+38:12214:x1876350931646336:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427916.997388:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427916.997470:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d67 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997573:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997593:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997606:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997619:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997647:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.997654:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998078:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998089:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998097:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427916.998108:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789427916.998323:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998331:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998338:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998344:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427916.998348:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998356:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998383:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427916.998387:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427916.998393:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998401:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518e22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998449:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998457:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998463:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998469:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427916.998471:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998478:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998486:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e600) 00010000:00010000:2.0:1789427916.998488:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427916.998491:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998496:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518e29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998557:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 41 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998573:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 40 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.998582:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427916.998584:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427916.998587:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789427916.999270:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+40:12214:x1876350931646336:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1918us (2730us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789427916.999281:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00100000:1.0:1789427917.007083:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427917.007296:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931646464 00000100:00100000:2.0:1789427917.007310:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931646464 00000100:00100000:2.0:1789427917.007389:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00100000:2.0:1789427917.007401:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+40:12214:x1876350931646464:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1789427917.007522:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007544:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007558:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007604:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007634:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007642:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007648:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427917.007653:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007661:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007675:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427917.007679:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427917.007686:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.007692:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518e3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427917.008152:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+40:12214:x1876350931646464:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 751us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427917.008161:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00100000:3.0:1789427917.012065:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427917.012176:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931646720 00000100:00100000:2.0:1789427917.012190:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931646720 00000100:00100000:2.0:1789427917.012264:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1789427917.012276:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12214:x1876350931646720:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427917.014738:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+41:12214:x1876350931646720:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 2437us (2724us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789427917.014774:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00010000:00010000:3.0:1789427917.234951:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427917.402657:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427917.402764:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931646976 00000100:00100000:0.0:1789427917.402774:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931646976 00000100:00100000:0.0:1789427917.402846:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 166 00000100:00100000:0.0:1789427917.402856:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+41:12245:x1876350931646976:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1789427917.402883:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427917.402905:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518e45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d6e expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.403044:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518e4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.403058:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.403068:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427917.403190:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789427917.403643:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518e45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d6e expref: 44 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.403661:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d6e expref: 43 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.403669:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427917.403672:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427917.403676:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ee00, rc 0) 00000100:00100000:0.0:1789427917.403741:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+43:12245:x1876350931646976:12345-192.168.202.24@tcp:101:cat.0 Request processed in 886us (1093us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789427917.403748:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 166 00000100:00100000:1.0:1789427917.414935:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427917.415271:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931647104 00000100:00100000:2.0:1789427917.415289:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931647104 00000100:00100000:2.0:1789427917.415383:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1789427917.415399:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+43:2396:x1876350931647104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427917.415449:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427917.415482:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518e4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d6e expref: 43 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.415508:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427917.415514:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427917.415572:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427917.415592:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+42:2396:x1876350931647104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 197us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427917.415602:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1789427917.415696:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931647360 00000100:00100000:1.0:1789427917.415845:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931647360 00000100:00100000:1.0:1789427917.415912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1789427917.415923:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+42:12245:x1876350931647360:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:1.0:1789427917.417832:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+43:12245:x1876350931647360:12345-192.168.202.24@tcp:35:cat.0 Request processed in 1907us (2257us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789427917.417844:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000001:00080000:3.0:1789427917.421772:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:3.0:1789427917.421814:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789427917.421843:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196984f56c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789427917.421849:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919583e3a900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9196984f5180 00000020:00080000:3.0:1789427917.421853:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919583e3a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919698b32c00 00000100:00100000:1.0:1789427917.422058:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427917.422090:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195847b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940092672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789427917.422174:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427917.422235:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940092672 00000100:00100000:3.0:1789427917.422247:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940092672 00000100:00100000:1.0:1789427917.423497:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789427917.423512:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940092672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789427917.423552:0:8401:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1789427917.423614:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa880cc, atime: 0x6aa880cc, ctime: 0x6aa880cc, blocks: 0x8 00010000:00010000:1.0:1789427917.423624:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.423644:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=261s v=(0 0) 00010000:00010000:1.0:1789427917.423649:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427917.423658:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.423675:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.423687:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.423696:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.423720:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427917.425460:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427917.425473:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.425486:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427917.425492:0:9487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.425504:0:9487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.425530:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.425538:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5cb3304/0x84fc867ede518e5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.425586:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427917.425588:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427917.425590:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427917.426720:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940092672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3207us (4540us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789427917.426732:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000020:00080000:2.0:1789427917.428914:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789427917.428998:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:3.0:1789427917.431353:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9195847b9c00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789427917.431372:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195847b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940092672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789427917.432670:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.432690:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.432699:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.432729:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427917.432734:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.432743:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.432765:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919581d4e500) 00010000:00010000:0.0:1789427917.432768:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427917.432774:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435405:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47200/0x84fc867ede518d34 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435917:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435925:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435932:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435939:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427917.435944:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435953:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.435999:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427917.436002:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427917.436007:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436014:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede518d3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436034:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436040:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436047:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436052:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427917.436055:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436061:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436069:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e600) 00010000:00010000:0.0:1789427917.436072:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427917.436074:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.436080:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede518d7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427917.520954:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427917.521095:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931647616 00000100:00100000:0.0:1789427917.521109:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931647616 00000100:00100000:0.0:1789427917.521208:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:0.0:1789427917.521222:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+18:12251:x1876350931647616:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789427917.521255:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427917.521259:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789427917.521293:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f600/0x84fc867ede518db2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d44 expref: 18 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521318:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427917.521324:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427917.521340:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518e61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d75 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521548:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521566:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521576:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521617:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.521633:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 18 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427917.521665:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583708000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940092800:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427917.521794:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427917.526015:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427917.526152:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583708000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940092800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427917.526185:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427917.526244:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931647744 00000100:00100000:3.0:1789427917.526253:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931647744 00010000:00010000:3.0:1789427917.526300:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 19 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427917.526392:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:3.0:1789427917.526404:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688831850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+19:2397:x1876350931647744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427917.526441:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427917.526450:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 19 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526464:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 19 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526490:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede518e30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d67 expref: 19 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526506:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427917.526511:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526542:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526551:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.526582:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427917.526646:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688831850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+18:2397:x1876350931647744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 244us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427917.526654:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00010000:00010000:2.0:1789427917.526747:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.526755:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427917.526799:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789427917.526962:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518e61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.526980:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.526988:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427917.526991:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427917.526993:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f400, rc 0) 00000100:00100000:2.0:1789427917.527019:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+18:12251:x1876350931647616:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5802us (6082us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789427917.527026:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:1.0:1789427917.534991:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427917.535127:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931647872 00000100:00100000:0.0:1789427917.535141:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931647872 00000100:00100000:0.0:1789427917.535258:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:0.0:1789427917.535270:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:12251:x1876350931647872:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789427917.535300:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427917.535329:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518e76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d7c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535373:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535392:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535407:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535580:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede518e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535601:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.535610:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427917.535620:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427917.535625:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e600, rc 0) 00000100:00100000:0.0:1789427917.535803:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+19:12251:x1876350931647872:12345-192.168.202.24@tcp:101:dd.0 Request processed in 535us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427917.535811:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:0.0:1789427917.540053:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427917.540186:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648128 00000100:00100000:3.0:1789427917.540196:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648128 00000100:00100000:3.0:1789427917.540266:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:3.0:1789427917.540277:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+19:12251:x1876350931648128:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:3.0:1789427917.540557:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.540575:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.540587:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427917.540630:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789427917.540655:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002f8379e7 reply state 00000000e663bd33 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.540667:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.540694:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427917.540697:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427917.540701:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427917.541727:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:12251:x1876350931648128:12345-192.168.202.24@tcp:36:dd.0 Request processed in 1434us (1666us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789427917.541739:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169 00000020:00080000:3.0:1789427917.541745:0:8108:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789427917.617072:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427917.617102:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427917.617191:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427917.617501:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940092928 00000100:00100000:0.0:1789427917.617512:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940092928 00000100:00100000:0.0:1789427917.617568:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789427917.617578:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940092928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789427917.617621:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789427917.617673:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940092928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427917.617680:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789427917.617930:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427917.819236:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819288:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819326:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819359:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819400:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819453:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427917.819480:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648512 00000100:00100000:1.0:1789427917.819489:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648512 00000100:00100000:1.0:1789427917.819544:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648640 00000100:00100000:1.0:1789427917.819548:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648640 00000100:00100000:1.0:1789427917.819641:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789427917.819653:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931648512:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427917.819723:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931648512:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.819731:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789427917.819750:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:1.0:1789427917.819757:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931648640:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427917.819926:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648768 00000100:00100000:3.0:1789427917.819931:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648768 00000100:00100000:3.0:1789427917.819960:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648384 00000100:00100000:3.0:1789427917.819963:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648384 00000100:00100000:3.0:1789427917.819976:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648896 00000100:00100000:3.0:1789427917.819979:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648896 00000100:00100000:3.0:1789427917.819992:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 305 00000100:00100000:3.0:1789427917.819997:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931648768:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427917.820024:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931648768:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427917.820030:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 305 00000100:00100000:3.0:1789427917.820042:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 306 00000100:00100000:3.0:1789427917.820047:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931648384:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427917.820064:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931648384:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 17us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427917.820069:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 306 00000100:00100000:3.0:1789427917.820077:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 307 00000100:00100000:3.0:1789427917.820083:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931648896:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427917.820110:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931648896:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427917.820115:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 307 00000100:00080000:3.0:1789427917.820154:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427917.820158:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427917.820160:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427917.820207:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931648640:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 450us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.820213:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:2.0:1789427917.820284:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931648256 00000100:00100000:2.0:1789427917.820288:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931648256 00000100:00100000:2.0:1789427917.820325:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 382 00000100:00100000:2.0:1789427917.820331:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931648256:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427917.820358:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a211a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931648256:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427917.820364:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 382 00000100:00100000:1.0:1789427918.011232:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.011464:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931649024 00000100:00100000:3.0:1789427918.011475:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931649024 00000100:00100000:3.0:1789427918.011566:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 170 00000100:00100000:3.0:1789427918.011577:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+22:12266:x1876350931649024:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:3.0:1789427918.011600:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.011621:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d83 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011690:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011705:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011732:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011752:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011760:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011767:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011882:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011894:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011903:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011937:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.011952:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 23 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.011966:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940093056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427918.012066:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4600 going to sleep for 11 seconds 00000100:00080000:2.0:1789427918.012155:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427918.032573:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.032884:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940093056:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427918.032913:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.033433:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931649280 00000100:00100000:1.0:1789427918.033443:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931649280 00000100:00100000:1.0:1789427918.033503:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:1.0:1789427918.033514:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:6154:x1876350931649280:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789427918.035349:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+25:6154:x1876350931649280:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 1830us (2780us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789427918.035361:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:1.0:1789427918.066564:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427918.066968:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931649408 00000100:00100000:2.0:1789427918.066989:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931649408 00010000:00010000:2.0:1789427918.067032:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 25 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427918.067108:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:2.0:1789427918.067121:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+25:2397:x1876350931649408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427918.067136:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427918.067142:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 25 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067153:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 25 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067173:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede518e68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d75 expref: 25 pid: 6482 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067187:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427918.067196:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067206:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067212:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.067328:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427918.067387:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+24:2397:x1876350931649408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 267us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.067397:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:3.0:1789427918.129471:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940093312:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129553:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129603:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940093824:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129627:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129642:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940094336:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129666:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129685:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789427918.129690:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940093440:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129765:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129792:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196a980b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940093952:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129810:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129822:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940094464:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.129893:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.129918:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093312 00000100:00100000:3.0:1789427918.129924:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093312 00000100:00100000:3.0:1789427918.129963:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789427918.129969:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130069:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940093184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427918.130109:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.130135:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093184 00000100:00100000:1.0:1789427918.130138:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093184 00000100:00100000:1.0:1789427918.130167:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427918.130172:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3613:x1876350940093184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427918.130193:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427918.130227:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3613:x1876350940093184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.130233:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427918.130276:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ae88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940093184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427918.130294:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940093696:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130313:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.130321:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940094208:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130338:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.130349:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940094720:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130362:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427918.130438:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940093312:12345-0@lo:400:kworker.0 Request processed in 469us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.130444:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789427918.130472:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093824 00000100:00100000:3.0:1789427918.130476:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093824 00000100:00100000:3.0:1789427918.130496:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094336 00000100:00100000:1.0:1789427918.130527:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789427918.130534:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940093568:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130766:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.130793:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940094080:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.130812:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.130826:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940094592:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.130885:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094336 00000100:00100000:3.0:1789427918.130904:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093440 00000100:00100000:3.0:1789427918.130906:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093440 00000100:00100000:3.0:1789427918.130916:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093952 00000100:00100000:3.0:1789427918.130917:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093952 00000100:00100000:3.0:1789427918.130927:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094464 00000100:00100000:3.0:1789427918.130928:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094464 00000100:00100000:3.0:1789427918.130937:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093696 00000100:00100000:3.0:1789427918.130939:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093696 00000100:00100000:3.0:1789427918.130949:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789427918.130954:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940093824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131083:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940093824:12345-0@lo:400:kworker.0 Request processed in 128us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131089:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789427918.131102:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789427918.131107:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940094336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131130:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940094336:12345-0@lo:400:kworker.0 Request processed in 23us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131134:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789427918.131143:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789427918.131147:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940093440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131165:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940093440:12345-0@lo:400:kworker.0 Request processed in 18us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131169:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789427918.131178:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789427918.131182:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940093952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131200:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940093952:12345-0@lo:400:kworker.0 Request processed in 18us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131204:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789427918.131212:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789427918.131216:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940094464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131233:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940094464:12345-0@lo:400:kworker.0 Request processed in 16us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131237:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789427918.131245:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789427918.131249:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940093696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131274:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940093696:12345-0@lo:400:kworker.0 Request processed in 24us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131279:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789427918.131302:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094208 00000100:00100000:3.0:1789427918.131305:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094208 00000100:00100000:3.0:1789427918.131325:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094720 00000100:00100000:3.0:1789427918.131327:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094720 00000100:00100000:3.0:1789427918.131340:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094080 00000100:00100000:3.0:1789427918.131341:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094080 00000100:00100000:3.0:1789427918.131351:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789427918.131355:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940094208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131378:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940094208:12345-0@lo:400:kworker.0 Request processed in 23us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.131382:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789427918.131391:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789427918.131395:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940094720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.131412:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940094720:12345-0@lo:400:kworker.0 Request processed in 17us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.131484:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.131506:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940093696:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131528:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940094208:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131537:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940094720:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131569:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094592 00000100:00100000:1.0:1789427918.131572:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094592 00000100:00100000:1.0:1789427918.131588:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789427918.131593:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940094080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131621:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940094080:12345-0@lo:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.131625:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789427918.131634:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789427918.131639:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfacca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131657:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfacca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940094592:12345-0@lo:400:kworker.0 Request processed in 18us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.131661:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789427918.131690:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940093440:0@lo:400:kworker.0 00010000:00080000:1.0:1789427918.131756:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196a980b100 x1876350940093952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427918.131769:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196a980b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940093952:0@lo:400:kworker.0 00010000:00080000:1.0:1789427918.131932:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ffb480 x1876350940094464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427918.131941:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940094464:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131948:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940093312:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131965:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940093824:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.131972:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940094336:0@lo:400:kworker.0 00000100:00100000:3.0:1789427918.132034:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789427918.132182:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940094080:0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.132190:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940094592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427918.195333:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940093568 00000100:00100000:2.0:1789427918.195365:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940093568 00000100:00100000:2.0:1789427918.195435:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427918.195446:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bface300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940093568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427918.195456:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427918.195523:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427918.195621:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bface300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940093568:12345-0@lo:400:kworker.0 Request processed in 177us (64854us total) trans 0 rc 0/0 00000100:00080000:3.0:1789427918.195624:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427918.195629:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789427918.195631:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427918.195634:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427918.195636:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427918.195693:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940094848 00000100:00100000:1.0:1789427918.195698:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940094848 00000100:00100000:3.0:1789427918.195851:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789427918.195860:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940094848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427918.195876:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00010000:00010000:0.0:1789427918.196048:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196059:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427918.196129:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940093568:0@lo:400:kworker.0 00000004:00200000:0.0:1789427918.196183:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789427918.196193:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427918.196219:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196234:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196243:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196249:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196255:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196261:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427918.196264:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196271:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196283:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427918.196286:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.196290:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196295:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede518e92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196309:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196324:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196330:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196334:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427918.196337:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196342:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196349:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919688862e00) 00010000:00010000:0.0:1789427918.196351:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.196354:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196360:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede518e99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196400:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208800/0x84fc867ede518e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d83 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196439:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d83 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.196594:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427918.196598:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427918.196607:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9400, rc 0) 00000100:00100000:0.0:1789427918.196650:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+23:12266:x1876350931649024:12345-192.168.202.24@tcp:101:stat.0 Request processed in 185075us (185428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427918.196658:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 170 00000100:00100000:3.0:1789427918.197889:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940094848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2027us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.197898:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427918.197908:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00010000:1.0:1789427918.258833:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427918.274402:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.274525:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931649664 00000100:00100000:3.0:1789427918.274538:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931649664 00000100:00100000:3.0:1789427918.274622:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 171 00000100:00100000:3.0:1789427918.274634:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+23:12272:x1876350931649664:12345-192.168.202.24@tcp:36:truncate.0 00010000:00010000:3.0:1789427918.274706:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427918.274740:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518ea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d83 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.274767:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427918.274787:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427918.275077:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.275095:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.275106:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427918.275157:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789427918.275182:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a531a46b reply state 000000004167b9af transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.275196:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.275203:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427918.275206:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789427918.275228:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427918.275859:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+25:12272:x1876350931649664:12345-192.168.202.24@tcp:36:truncate.0 Request processed in 1225us (1469us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789427918.275869:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 171 00000020:00080000:3.0:1789427918.275876:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789427918.373958:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.374136:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931649792 00000100:00100000:0.0:1789427918.374395:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931649792 00000100:00100000:2.0:1789427918.374946:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:2.0:1789427918.374959:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+25:12286:x1876350931649792:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:2.0:1789427918.374995:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427918.375024:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d8a expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375112:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375129:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375158:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375174:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375181:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375187:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375296:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375305:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375311:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427918.375359:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789427918.375365:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427918.375389:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375401:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375409:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375436:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375443:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375449:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427918.375454:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375462:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375479:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427918.375482:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427918.375487:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375494:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518eb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375507:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375512:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375517:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375522:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427918.375524:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375529:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375534:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9196a05ef500) 00010000:00010000:2.0:1789427918.375536:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427918.375538:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375543:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518ebc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375583:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 27 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375595:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 26 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.375602:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427918.375604:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427918.375607:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427918.375817:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+26:12286:x1876350931649792:12345-192.168.202.24@tcp:101:stat.0 Request processed in 860us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.375824:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:1.0:1789427918.448261:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.448363:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931650048 00000100:00100000:0.0:1789427918.448376:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931650048 00000100:00100000:0.0:1789427918.448481:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:0.0:1789427918.448495:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+26:12296:x1876350931650048:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427918.448524:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427918.448550:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d91 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427918.448680:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789427918.449077:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518eca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d91 expref: 28 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.449095:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:0.0:1789427918.449099:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427918.449105:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d91 expref: 28 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.449121:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f200, rc 0) 00000100:00100000:0.0:1789427918.449452:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+27:12296:x1876350931650048:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 959us (1203us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789427918.449460:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:1.0:1789427918.453079:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.453250:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931650304 00000100:00100000:0.0:1789427918.453279:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931650304 00000100:00100000:0.0:1789427918.453348:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789427918.453359:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+27:12296:x1876350931650304:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427918.453654:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+28:12296:x1876350931650304:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 295us (586us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789427918.453663:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1789427918.507820:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.507959:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931650560 00000100:00100000:0.0:1789427918.507972:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931650560 00000100:00100000:0.0:1789427918.508047:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:0.0:1789427918.508059:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+28:12302:x1876350931650560:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789427918.508090:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427918.508116:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518ed8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d98 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.508268:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.508286:0:10064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 29 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.508297:0:10064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.508337:0:10064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 29 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.508353:0:10064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 29 pid: 8108 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427918.508393:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583708700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940094976:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427918.508555:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789427918.512578:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427918.512670:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931650688 00000100:00100000:2.0:1789427918.512680:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931650688 00010000:00010000:2.0:1789427918.512729:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 30 pid: 8108 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427918.512788:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:2.0:1789427918.512800:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+30:2396:x1876350931650688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427918.512819:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427918.512836:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 30 pid: 8108 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.512851:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 30 pid: 8108 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.512908:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427918.512913:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.512926:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.512935:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.512958:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427918.513032:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+30:2396:x1876350931650688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 234us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.513039:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00010000:00010000:0.0:1789427918.514113:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518ec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d8a expref: 29 pid: 8108 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427918.514137:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583708700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10064:1876350940094976:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427918.514162:0:10064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.514172:0:10064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.514179:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427918.514201:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789427918.514386:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede518ed8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 30 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.514405:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 29 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.514450:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427918.514453:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789427918.514456:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f800, rc 0) 00000100:00100000:0.0:1789427918.514505:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+29:12302:x1876350931650560:12345-192.168.202.24@tcp:101:bash.0 Request processed in 6447us (6698us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789427918.514525:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:1.0:1789427918.519056:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427918.519159:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931650944 00000100:00100000:2.0:1789427918.519171:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931650944 00000100:00100000:2.0:1789427918.519245:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:2.0:1789427918.519257:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+29:12302:x1876350931650944:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:2.0:1789427918.519575:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.519597:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.519612:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427918.519660:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789427918.519689:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f659b657 reply state 000000000f583a06 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.519721:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.519729:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427918.519732:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789427918.519736:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427918.519876:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+32:12302:x1876350931650944:12345-192.168.202.24@tcp:36:bash.0 Request processed in 620us (832us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789427918.519884:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 175 00000020:00080000:2.0:1789427918.519891:0:8108:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789427918.525234:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.526009:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931651072 00000100:00100000:0.0:1789427918.526025:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931651072 00000100:00100000:1.0:1789427918.526195:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1789427918.526209:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+32:12302:x1876350931651072:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1789427918.526244:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427918.526270:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ef4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300d9f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.526395:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.526457:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 33 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.526469:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.526515:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 33 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.526532:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 33 pid: 10064 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.526549:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940095104:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427918.526677:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938480 going to sleep for 11 seconds 00000100:00100000:3.0:1789427918.529817:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940095104:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427918.529904:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.530196:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.530556:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931651200 00000100:00100000:3.0:1789427918.530565:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931651200 00010000:00010000:3.0:1789427918.530608:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 34 pid: 10064 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.530704:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:3.0:1789427918.530715:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+34:2397:x1876350931651200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427918.530733:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427918.530741:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 34 pid: 10064 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530754:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 34 pid: 10064 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530791:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f800/0x84fc867ede518edf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d98 expref: 34 pid: 10064 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530812:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427918.530846:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530859:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530867:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.530903:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427918.530976:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+33:2397:x1876350931651200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 262us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.530983:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 86 00010000:00010000:1.0:1789427918.531278:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.531287:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427918.531353:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789427918.531358:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427918.531380:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.531445:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518ef4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d9f expref: 33 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.531476:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d9f expref: 32 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.531485:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:1.0:1789427918.531488:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427918.531490:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47e00, rc 0) 00000100:00100000:1.0:1789427918.531532:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+32:12302:x1876350931651072:12345-192.168.202.24@tcp:101:bash.0 Request processed in 5326us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.531539:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1789427918.535021:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.535108:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931651456 00000100:00100000:0.0:1789427918.535118:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931651456 00000100:00100000:0.0:1789427918.535189:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:0.0:1789427918.535200:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+32:12302:x1876350931651456:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1789427918.535481:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+33:12302:x1876350931651456:12345-192.168.202.24@tcp:35:bash.0 Request processed in 282us (474us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789427918.535490:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:0.0:1789427918.603382:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.603489:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931651712 00000100:00100000:3.0:1789427918.603499:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931651712 00000100:00100000:3.0:1789427918.603564:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:3.0:1789427918.603575:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+33:12312:x1876350931651712:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427918.603599:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.603632:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300da6 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427918.603725:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789427918.604014:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518f02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300da6 expref: 35 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.604028:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427918.604031:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427918.604036:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9400/0x84fc867ede518f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300da6 expref: 35 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.604066:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9400, rc 0) 00000100:00100000:3.0:1789427918.604180:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+34:12312:x1876350931651712:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 607us (820us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789427918.604187:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:1.0:1789427918.608635:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.608706:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931651840 00000100:00100000:3.0:1789427918.608715:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931651840 00000100:00100000:3.0:1789427918.608775:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:3.0:1789427918.608784:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+34:12312:x1876350931651840:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1789427918.608861:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608876:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608887:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608900:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608906:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608921:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.608991:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609014:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609021:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427918.609060:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609072:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609078:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609085:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609090:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427918.609094:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609100:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609110:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427918.609112:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427918.609117:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609122:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9800/0x84fc867ede518f10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609470:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609478:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609485:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609491:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427918.609494:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609500:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609508:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919688862b00) 00010000:00010000:3.0:1789427918.609511:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427918.609514:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609519:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede518f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609534:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609540:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609545:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609556:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427918.609559:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609566:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609574:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427918.609576:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427918.609579:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.609585:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.609646:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+34:12312:x1876350931651840:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 862us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.609654:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:1.0:1789427918.613344:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.613451:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931652096 00000100:00100000:0.0:1789427918.613461:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931652096 00000100:00100000:0.0:1789427918.613517:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789427918.613528:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+34:12312:x1876350931652096:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427918.613867:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+35:12312:x1876350931652096:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 341us (532us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789427918.613874:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789427918.676230:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427918.676458:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931652352 00000100:00100000:1.0:1789427918.676469:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931652352 00000100:00100000:1.0:1789427918.676537:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:1.0:1789427918.676547:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+35:12315:x1876350931652352:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427918.676569:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427918.676591:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518f25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676661:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676675:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676685:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676728:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676736:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676742:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676860:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede518f3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676870:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede518f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676877:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede518f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427918.676886:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789427918.676976:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676985:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676992:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.676998:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427918.677002:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677019:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677030:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427918.677033:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427918.677037:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677043:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede518f2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677055:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677060:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677066:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677070:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427918.677072:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677078:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677083:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4ef00) 00010000:00010000:1.0:1789427918.677085:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427918.677087:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677099:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede518f33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677136:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede518f25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dad expref: 38 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677458:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede518f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dad expref: 37 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.677466:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:1.0:1789427918.677469:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427918.677473:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46200, rc 0) 00000100:00100000:1.0:1789427918.677535:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+37:12315:x1876350931652352:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 989us (1314us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789427918.677542:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:1.0:1789427918.683246:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427918.683317:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.683511:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931652608 00000100:00100000:0.0:1789427918.683520:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931652608 00000100:00100000:0.0:1789427918.683582:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:0.0:1789427918.683591:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+37:2397:x1876350931652608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427918.683607:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427918.683629:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede518f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dad expref: 37 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.683654:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427918.683658:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427918.683714:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+36:2397:x1876350931652608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 124us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427918.683721:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1789427918.684086:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931652480 00000100:00100000:3.0:1789427918.684091:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931652480 00000100:00100000:3.0:1789427918.684128:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:3.0:1789427918.684135:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+36:12315:x1876350931652480:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1789427918.684186:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684210:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684219:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684261:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684268:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684274:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684279:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427918.684283:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684291:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684300:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427918.684303:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427918.684307:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.684313:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.684356:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+36:12315:x1876350931652480:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 222us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.684362:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:1.0:1789427918.687647:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.687824:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931652864 00000100:00100000:3.0:1789427918.687842:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931652864 00000100:00100000:3.0:1789427918.687900:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1789427918.687933:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+36:12315:x1876350931652864:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1789427918.688331:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+37:12315:x1876350931652864:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 399us (690us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789427918.688338:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1789427918.917794:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.917934:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931653120 00000100:00100000:0.0:1789427918.917946:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931653120 00000100:00100000:0.0:1789427918.918012:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:0.0:1789427918.918023:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+37:12333:x1876350931653120:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1789427918.918048:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427918.918067:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518f4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300db4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.918734:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.918750:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.919041:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427918.919057:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789427918.919758:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518f4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300db4 expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.919901:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300db4 expref: 39 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.920208:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427918.920212:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427918.920217:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ee00, rc 0) 00000100:00100000:0.0:1789427918.920323:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+39:12333:x1876350931653120:12345-192.168.202.24@tcp:101:cat.0 Request processed in 2301us (2538us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789427918.920332:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:1.0:1789427918.965942:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427918.966468:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931653248 00000100:00100000:3.0:1789427918.966479:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931653248 00000100:00100000:3.0:1789427918.966591:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:3.0:1789427918.966601:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+39:12334:x1876350931653248:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427918.966624:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.966645:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dbb expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966719:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966733:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966743:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427918.966802:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789427918.966806:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789427918.966838:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966866:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518f64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dbb expref: 41 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966920:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dbb expref: 40 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.966929:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427918.966932:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427918.966936:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000100:00100000:3.0:1789427918.967007:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+40:12334:x1876350931653248:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 407us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.967203:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:1.0:1789427918.978387:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.978518:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931653632 00000100:00100000:0.0:1789427918.978528:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931653632 00000100:00100000:0.0:1789427918.978589:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1789427918.978601:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+40:12334:x1876350931653632:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427918.979126:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+41:12334:x1876350931653632:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 526us (747us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789427918.979135:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1789427918.982526:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.982803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931653760 00000100:00100000:0.0:1789427918.982813:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931653760 00000100:00100000:0.0:1789427918.982893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1789427918.982903:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+41:12334:x1876350931653760:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:0.0:1789427918.982929:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789427918.982955:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede518efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d9f expref: 41 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.982976:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300db4 expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.982989:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede518df1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d59 expref: 39 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.983006:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427918.983208:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427918.983265:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+38:12334:x1876350931653760:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 363us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427918.983273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:1.0:1789427918.990442:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427918.990593:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931653888 00000100:00100000:0.0:1789427918.990603:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931653888 00000100:00100000:0.0:1789427918.990664:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:0.0:1789427918.990674:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+38:12334:x1876350931653888:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:0.0:1789427918.990793:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.990811:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.990833:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789427918.990936:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789427918.991126:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+38:12334:x1876350931653888:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 452us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427918.991134:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:1.0:1789427919.067389:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.069358:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654016 00000100:00100000:0.0:1789427919.069383:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654016 00000100:00100000:0.0:1789427919.069789:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:0.0:1789427919.069802:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+38:12336:x1876350931654016:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427919.069932:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427919.069980:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518f79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dc2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070291:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070310:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070324:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070341:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070348:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070355:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.070993:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071103:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071115:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427919.071289:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789427919.071295:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427919.071319:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071346:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071603:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071611:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071618:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071626:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.071631:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071639:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071654:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427919.071658:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427919.071664:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071671:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071685:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071692:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071706:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071711:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.071714:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071721:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071730:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91958354dc00) 00010000:00010000:0.0:1789427919.071732:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427919.071735:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071740:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071796:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518f79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.071812:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 39 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.072140:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427919.072143:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427919.072216:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ea00, rc 0) 00000100:00100000:0.0:1789427919.072318:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+39:12336:x1876350931654016:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2517us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.072336:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:1.0:1789427919.152807:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427919.153306:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427919.153684:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940095232 00000100:00100000:3.0:1789427919.153695:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940095232 00000100:00100000:3.0:1789427919.153759:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789427919.159542:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427919.159589:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940095360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427919.159667:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.159750:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940095360 00000100:00100000:1.0:1789427919.159759:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940095360 00000100:00100000:3.0:1789427919.168796:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940095232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427919.168849:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789427919.168966:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940095232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (15660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.168975:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789427919.169057:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427919.178745:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789427919.178847:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940095360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789427919.179645:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789427919.179778:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940095360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1015us (20108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.179787:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789427919.181878:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940095360:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789427919.280681:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427919.345562:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427919.345572:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427919.345607:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789427919.345614:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427919.345752:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940095488:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427919.345974:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427919.357333:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.357373:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654144 00000100:00100000:3.0:1789427919.357381:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654144 00000100:00100000:3.0:1789427919.357451:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:3.0:1789427919.357461:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654144:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789427919.357493:0:8108:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789427919.357609:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654144:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 149us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.357616:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:2.0:1789427919.357943:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940095488:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427919.362727:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.362993:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654272 00000100:00100000:0.0:1789427919.363015:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654272 00000100:00100000:0.0:1789427919.363075:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:0.0:1789427919.363085:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+39:12347:x1876350931654272:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789427919.363156:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363173:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363186:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363221:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363229:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363236:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363263:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363272:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363294:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427919.363339:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789427919.363356:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427919.363369:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363380:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363386:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363394:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363401:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.363405:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363755:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363781:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:0.0:1789427919.363784:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427919.363791:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363799:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede518f95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363827:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363833:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363840:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363845:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.363848:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363855:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363863:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff91958354dc00) 00010000:00010000:0.0:1789427919.363866:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427919.363869:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363875:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede518f9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363890:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363897:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363902:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363912:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.363915:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363921:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363929:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427919.363931:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427919.363934:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.363940:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede518fa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.364023:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+39:12347:x1876350931654272:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 938us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.364032:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:3.0:1789427919.367311:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.367523:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654528 00000100:00100000:0.0:1789427919.367533:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654528 00000100:00100000:0.0:1789427919.367618:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:0.0:1789427919.367628:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+39:12347:x1876350931654528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427919.367648:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427919.367666:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518faa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dc9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.367787:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.367824:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.367836:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427919.367847:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789427919.368045:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368053:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368059:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368064:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427919.368068:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368075:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368085:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427919.368088:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427919.368091:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368097:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede518fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368135:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518faa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc9 expref: 41 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368270:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:0.0:1789427919.368273:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427919.368278:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede518faa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc9 expref: 41 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.368289:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fa00, rc 0) 00000100:00100000:0.0:1789427919.368434:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 808us (1130us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789427919.368441:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:2.0:1789427919.435925:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.436153:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654656 00000100:00100000:3.0:1789427919.436164:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654656 00000100:00100000:2.0:1789427919.437112:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:2.0:1789427919.437124:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654656:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427919.437157:0:6483:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427919.437287:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654656:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 165us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.437295:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:2.0:1789427919.442628:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.443150:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931654912 00000100:00100000:1.0:1789427919.443160:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931654912 00000100:00100000:1.0:1789427919.443226:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:1.0:1789427919.443235:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931654912:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427919.443255:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427919.443258:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789427919.443286:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede518f6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dbb expref: 40 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.443309:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427919.443314:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427919.443391:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518fbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dd0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427919.443796:0:6482:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789427919.443958:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518fc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.444000:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.444012:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.444066:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518fbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd0 expref: 42 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.444081:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd0 expref: 41 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.444088:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef500) 00010000:00010000:2.0:1789427919.444091:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427919.444093:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427919.444157:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+41:12347:x1876350931654912:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 922us (1538us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789427919.444165:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:1.0:1789427919.531968:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.532049:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931655168 00000100:00100000:3.0:1789427919.532061:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931655168 00000100:00100000:3.0:1789427919.532129:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:3.0:1789427919.532145:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+41:12347:x1876350931655168:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.532210:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427919.532240:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede518fc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd0 expref: 41 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532259:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef500) 00010000:00010000:3.0:1789427919.532270:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427919.532293:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532308:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532317:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532344:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532352:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.532359:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533116:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533125:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533133:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533139:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427919.533144:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533352:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533454:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427919.533457:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427919.533463:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533469:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede518fd4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533482:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533489:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533495:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533500:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427919.533503:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533509:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533516:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x937c43b1 (ffff919688862500) 00010000:00010000:2.0:1789427919.533519:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427919.533522:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.533538:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede518fdb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x937c43b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.533628:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931655168:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1487us (1665us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427919.533636:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:0.0:1789427919.540667:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.540801:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931655296 00000100:00100000:2.0:1789427919.540827:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931655296 00000100:00100000:2.0:1789427919.541084:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:2.0:1789427919.541096:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12347:x1876350931655296:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427919.541118:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427919.541142:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518fe2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dd7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541316:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541330:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541342:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541474:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518fe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 42 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541491:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 41 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.541510:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:2.0:1789427919.541514:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427919.541517:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427919.541576:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+41:12347:x1876350931655296:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 482us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.541583:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:3.0:1789427919.554735:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.554824:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931655552 00000100:00100000:0.0:1789427919.554836:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931655552 00000100:00100000:3.0:1789427919.554979:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 192 00000100:00100000:3.0:1789427919.554992:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+41:12347:x1876350931655552:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.555482:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.555501:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.555514:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789427919.563024:0:10064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789427919.563052:0:10064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 264057635803ns, next at 265057628588ns, rc = 0 00000004:00010000:1.0:1789427919.563141:0:10064:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e4374c4 reply state 00000000cefb4966 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.563172:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.563197:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:1.0:1789427919.563200:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789427919.563204:0:10064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427919.563525:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+43:12347:x1876350931655552:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 8532us (9339us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789427919.563536:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 192 00000100:00100000:0.0:1789427919.570797:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.570855:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931655680 00000100:00100000:2.0:1789427919.570866:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931655680 00000100:00100000:2.0:1789427919.570927:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:2.0:1789427919.570938:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195847b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+43:12347:x1876350931655680:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427919.570961:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427919.570982:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dde expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.571038:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.571054:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.571086:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:2.0:1789427919.571089:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427919.571092:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428c00, rc 0) 00000100:00100000:2.0:1789427919.571166:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195847b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+44:12347:x1876350931655680:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 229us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.571199:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:0.0:1789427919.575126:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.575179:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931655808 00000100:00100000:3.0:1789427919.575295:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931655808 00000100:00100000:3.0:1789427919.575360:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789427919.575369:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+6:2396:x1876350931655808:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789427919.575592:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931655808:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 223us (475us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789427919.575600:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00080000:2.0:1789427919.578630:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427919.582059:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.582093:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656064 00000100:00100000:3.0:1789427919.582107:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656064 00000100:00100000:3.0:1789427919.582162:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1789427919.582171:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+44:12347:x1876350931656064:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789427919.582388:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+45:12347:x1876350931656064:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 219us (340us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789427919.582396:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:0.0:1789427919.591603:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.591822:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656320 00000100:00100000:2.0:1789427919.591834:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656320 00000100:00100000:2.0:1789427919.592172:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:2.0:1789427919.592185:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+45:12347:x1876350931656320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789427919.592302:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+45:12347:x1876350931656320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 120us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.592311:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:1.0:1789427919.611441:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.611470:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656448 00000100:00100000:1.0:1789427919.611478:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656448 00000100:00100000:1.0:1789427919.611524:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:1.0:1789427919.611532:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+45:12347:x1876350931656448:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427919.611551:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427919.611569:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518ffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300de5 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611630:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611643:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611654:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427919.611703:0:10064:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427919.611720:0:10064:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611750:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede518ffe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300de5 expref: 47 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611784:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300de5 expref: 46 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.611793:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:1.0:1789427919.611796:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789427919.611800:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46e00, rc 0) 00000100:00100000:1.0:1789427919.611880:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+46:12347:x1876350931656448:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 347us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.611887:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:0.0:1789427919.616601:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.617014:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656576 00000100:00100000:2.0:1789427919.617024:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656576 00000100:00100000:2.0:1789427919.617082:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1789427919.617090:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931656576:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427919.617105:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427919.617133:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dec expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427919.617156:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880cf, blocks: 0x0 00010000:00010000:2.0:1789427919.617173:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=264s v=(0 0) 00010000:00010000:2.0:1789427919.617177:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427919.617186:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.617212:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.617236:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789427919.617288:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931656576:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 199us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.617295:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:1.0:1789427919.632872:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.637466:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656832 00000100:00100000:3.0:1789427919.637480:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656832 00000100:00100000:3.0:1789427919.637540:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:3.0:1789427919.637550:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+46:12347:x1876350931656832:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427919.637680:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+46:12347:x1876350931656832:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 131us (4932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.637687:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:0.0:1789427919.651223:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.651302:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931656960 00000100:00100000:3.0:1789427919.651312:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931656960 00000100:00100000:3.0:1789427919.651372:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:3.0:1789427919.651383:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:12347:x1876350931656960:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.651401:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427919.651450:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300df3 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.651486:0:8400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.651496:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427919.651509:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427919.651515:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.651549:0:8400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.651563:0:8400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 9 pid: 8401 timeout: 364 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.651578:0:8400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8400:1876350940095616:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427919.651667:0:8400:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427919.655356:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.655461:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657088 00000100:00100000:2.0:1789427919.655470:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657088 00010000:00010000:2.0:1789427919.655510:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 10 pid: 8401 timeout: 364 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.655543:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:2.0:1789427919.655552:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931657088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427919.655566:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427919.655586:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 10 pid: 8401 timeout: 364 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.655599:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 10 pid: 8401 timeout: 364 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.655620:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427919.655625:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427919.655633:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 10 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.655642:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 10 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.655701:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 10 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.655716:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940095744:192.168.202.24@tcp:105: 00000100:00100000:2.0:1789427919.655818:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488900 going to sleep for 11 seconds 00010000:00010000:3.0:1789427919.658550:0:8400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eadb188/0x84fc867ede51900c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dec expref: 10 pid: 8401 timeout: 364 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.658572:0:8400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8400:1876350940095616:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427919.658601:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.658615:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed800, rc 0) 00000100:00100000:3.0:1789427919.658671:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+9:12347:x1876350931656960:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 7290us (7458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.658680:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:0.0:1789427919.672082:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.672156:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657216 00000100:00100000:1.0:1789427919.672166:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657216 00002000:00100000:1.0:1789427919.672215:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91958457d180 x1876350931657216/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:165/0 lens 504/0 e 0 to 0 dl 1789427930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789427919.672227:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958457d180 with x1876350931657216 ext(0->8) 00002000:00010000:1.0:1789427919.672233:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958457d180 00000100:00100000:1.0:1789427919.672265:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789427919.672273:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931657216:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789427919.673165:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940095744:192.168.202.24@tcp:105: 00010000:00010000:3.0:1789427919.673188:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427919.673256:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2396:x1876350931657088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 17706us (17909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.673265:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:2.0:1789427919.820166:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+10:2397:x1876350931657216:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 147882us (148083us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789427919.820180:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00002000:00100000:2.0:1789427919.820195:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91958457d180 x1876350931657216/t4294967315(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:165/0 lens 504/448 e 0 to 0 dl 1789427930 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427919.820205:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958457d180 with x1876350931657216 ext(0->8) 00002000:00010000:2.0:1789427919.820212:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958457d180 00000100:00100000:2.0:1789427919.829245:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.829323:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657344 00000100:00100000:3.0:1789427919.829333:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657344 00000100:00100000:3.0:1789427919.829394:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:3.0:1789427919.829405:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+46:12347:x1876350931657344:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789427919.898981:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789427919.898999:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789427919.899047:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1789427919.899204:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+23:12347:x1876350931657344:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 69795us (69963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.899215:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 197 00010000:00010000:3.0:1789427919.899638:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899651:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899659:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899665:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.899670:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899679:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899751:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427919.899779:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427919.899786:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.899793:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede518e84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.899972:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427919.899988:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940095872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427919.900039:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427919.900105:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940095872 00000100:00100000:2.0:1789427919.900112:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940095872 00000100:00100000:2.0:1789427919.900150:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789427919.900158:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940095872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789427919.900270:0:13777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789427919.900273:0:13777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789427919 00002000:00010000:2.0:1789427919.900276:0:13777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789427919.900279:0:13777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789427919 -> 1789427919 00002000:00010000:2.0:1789427919.900288:0:13777:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789427919.900320:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940095872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (281us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789427919.900328:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1789427919.900366:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919583fd5f80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789427919.900371:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940095872:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789427919.900441:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900450:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900457:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900463:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.900466:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900473:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900482:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427919.900485:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427919.900489:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900495:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede518ea7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900504:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900511:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900517:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900528:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.900531:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900537:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900546:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427919.900548:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427919.900551:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900558:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede518eed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900569:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900575:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900581:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900586:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.900589:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900595:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900611:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:3.0:1789427919.900613:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427919.900616:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.900622:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede518ff0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789427919.900798:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789427919.900823:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789427919.904187:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.904305:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657472 00000100:00100000:0.0:1789427919.904314:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657472 00000100:00100000:0.0:1789427919.904368:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:0.0:1789427919.904377:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+10:2397:x1876350931657472:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789427919.907043:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789427919.907061:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789427919.907251:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931657472:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 2866us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.907265:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:0.0:1789427919.909951:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.910087:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657728 00000100:00100000:1.0:1789427919.910099:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657728 00000100:00100000:1.0:1789427919.910204:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 198 00000100:00100000:1.0:1789427919.910215:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+19:12347:x1876350931657728:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789427919.910302:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427919.910337:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede519005 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300de5 expref: 19 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.910360:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:1.0:1789427919.910366:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427919.910398:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.910858:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.910874:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427919.911038:0:6484:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bf712385 reply state 00000000a5796471 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.911053:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.911060:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:1.0:1789427919.911063:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427919.911066:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427919.911182:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+20:12347:x1876350931657728:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 967us (1242us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789427919.911190:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 198 00000100:00100000:2.0:1789427919.913617:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.913849:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931657856 00000100:00100000:3.0:1789427919.913861:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931657856 00000100:00100000:3.0:1789427919.914090:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:3.0:1789427919.914102:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931657856:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789427919.914274:0:8400:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789427919.914278:0:8400:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789427919 -> 1789427918 00002000:00010000:3.0:1789427919.914281:0:8400:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789427916 00002000:00010000:3.0:1789427919.914283:0:8400:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789427919 -> 1789427918 00002000:00010000:3.0:1789427919.914286:0:8400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789427919.914352:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931657856:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 252us (745us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789427919.914360:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:3.0:1789427919.917062:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.917753:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658112 00000100:00100000:0.0:1789427919.917780:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658112 00000100:00100000:0.0:1789427919.917926:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:0.0:1789427919.917940:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+20:12347:x1876350931658112:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789427919.918030:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.918051:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.918063:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.918104:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.918119:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 20 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.918137:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940096000:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427919.918268:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427919.922082:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.923904:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658240 00000100:00100000:1.0:1789427919.923918:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658240 00010000:00010000:1.0:1789427919.923978:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 21 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.924242:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940096000:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427919.924275:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427919.924476:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:1.0:1789427919.924489:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688830050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:2397:x1876350931658240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427919.924509:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427919.924518:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 21 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.924533:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 21 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.924560:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede518fe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dd7 expref: 21 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.924579:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:1.0:1789427919.924585:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.924596:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.924605:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.925031:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427919.925110:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688830050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:2397:x1876350931658240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 623us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.925119:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00010000:00010000:2.0:1789427919.925303:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925312:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925362:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925370:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925378:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925384:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427919.925390:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925431:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925444:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:2.0:1789427919.925447:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789427919.925452:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.925458:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519021 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.925508:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+19:12347:x1876350931658112:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 7571us (8464us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789427919.925518:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:0.0:1789427919.929100:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.929169:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658368 00000100:00100000:2.0:1789427919.929185:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658368 00000100:00100000:2.0:1789427919.929265:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1789427919.929277:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931658368:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789427919.929331:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.929358:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.929369:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427919.929375:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427919.929382:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.929473:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.929491:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 8 pid: 8400 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.929510:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940096128:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427919.929613:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427919.932347:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8401:1876350940096128:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427919.932372:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.933250:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427919.933396:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658496 00000100:00100000:1.0:1789427919.933461:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658496 00010000:00010000:1.0:1789427919.933498:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427919.933529:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:1.0:1789427919.933538:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931658496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427919.933554:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427919.933575:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.933586:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.933606:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9bd9257/0x84fc867ede519013 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300df3 expref: 9 pid: 8400 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.933622:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427919.933627:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427919.933633:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.933642:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.933667:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427919.933841:0:8401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933851:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933873:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933882:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933903:0:8401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933910:0:8401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427919.933915:0:8401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933924:0:8401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933936:0:8401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.933944:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede519028 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427919.934032:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931658496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 493us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.934050:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:2.0:1789427919.934565:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2397:x1876350931658368:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 5289us (5475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.934574:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1789427919.938337:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427919.938499:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658752 00000100:00100000:3.0:1789427919.938508:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658752 00000100:00100000:3.0:1789427919.938588:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 200 00000100:00100000:3.0:1789427919.938611:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+19:12347:x1876350931658752:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.938694:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.938711:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.938719:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.938752:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.938778:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 19 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.938792:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096256:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427919.938970:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427919.950326:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427919.950359:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931658880 00000100:00100000:2.0:1789427919.950368:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931658880 00010000:00010000:2.0:1789427919.950403:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 20 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.950483:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:2.0:1789427919.950493:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+20:2396:x1876350931658880:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427919.950509:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427919.950516:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 20 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.950529:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 20 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.950552:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427919.950558:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.950568:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.950576:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.950596:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427919.950644:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+20:2396:x1876350931658880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 153us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427919.950652:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90 00010000:00010000:3.0:1789427919.951209:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede518e7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d7c expref: 19 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.951228:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096256:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427919.951247:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951257:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951274:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951472:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951485:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951494:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951521:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.951534:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 19 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.951546:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096384:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427919.951607:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427919.959155:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.959226:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931659008 00000100:00100000:0.0:1789427919.959235:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931659008 00010000:00010000:0.0:1789427919.959272:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 20 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.959314:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:0.0:1789427919.959324:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:2397:x1876350931659008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427919.959339:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427919.959346:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 20 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.959358:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 20 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.959380:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:0.0:1789427919.959386:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.959396:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.959403:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.959458:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427919.959505:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:2397:x1876350931659008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 182us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.959511:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 91 00010000:00010000:3.0:1789427919.960125:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede518ff7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dde expref: 19 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.960154:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096384:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427919.960177:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.960186:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.960203:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427919.960308:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789427919.960447:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789427919.960481:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789427919.960556:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6483:1876350940096512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789427919.960607:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427919.961047:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940096512 00000100:00100000:0.0:1789427919.961054:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940096512 00000100:00100000:0.0:1789427919.961093:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789427919.961102:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6483:x1876350940096512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789427919.961192:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6483:x1876350940096512:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.961199:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789427919.961481:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427919.961496:0:6483:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789427919.961502:0:6483:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919583fd5f80, transno 4294967316 00000100:00100000:3.0:1789427919.961513:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6483:1876350940096512:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789427919.961614:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789427919.961655:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6483:1876350940096640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789427919.961684:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427919.961697:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427919.962305:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940096640 00000100:00100000:2.0:1789427919.962312:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940096640 00000100:00100000:2.0:1789427919.962353:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427919.962373:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6483:x1876350940096640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789427919.962509:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6483:x1876350940096640:12345-0@lo:1000:mdt00_001.0 Request processed in 138us (824us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789427919.962516:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427919.962552:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6483:1876350940096640:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789427919.962583:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962592:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962600:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962606:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427919.962610:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962617:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962633:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:2.0:1789427919.962636:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427919.962640:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962647:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede519036 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962669:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962681:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962701:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962706:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ee00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427919.962709:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962714:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962723:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:2.0:1789427919.962725:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427919.962728:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.962733:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede518f72 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.963039:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.963056:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.963065:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.963092:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.963112:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 22 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.963124:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096768:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427919.963194:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b488900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427919.966109:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940096768:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427919.966129:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.966335:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.966397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931659136 00000100:00100000:0.0:1789427919.966404:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931659136 00010000:00010000:0.0:1789427919.966461:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.966492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:0.0:1789427919.966501:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+23:2396:x1876350931659136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427919.966515:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427919.966521:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966548:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966567:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede518f8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dc2 expref: 23 pid: 6484 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966580:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:0.0:1789427919.966585:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966593:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966600:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.966625:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427919.966674:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:2396:x1876350931659136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 173us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.966682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92 00010000:00010000:3.0:1789427919.966872:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966881:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966892:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966898:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966914:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966920:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.966923:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966930:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966939:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427919.966941:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427919.966945:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966951:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede51903d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966963:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966969:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966975:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966980:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427919.966982:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.966997:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.967006:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff919581d4eb00) 00010000:00010000:3.0:1789427919.967008:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427919.967012:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.967018:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51902f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.967258:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:12347:x1876350931658752:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 28648us (28929us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789427919.967266:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 200 00000020:00080000:3.0:1789427919.967270:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789427919.973821:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427919.973830:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427919.974377:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789427919.974385:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427919.980887:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427919.982798:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931659392 00000100:00100000:0.0:1789427919.982931:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931659392 00000100:00100000:0.0:1789427919.984537:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:0.0:1789427919.984552:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+21:12347:x1876350931659392:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789427919.984836:0:6485:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789427919.984870:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1789427919.984904:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984926:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984939:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984948:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984955:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984961:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.984983:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789427919.985074:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+23:12347:x1876350931659392:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 526us (4196us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789427919.985082:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000020:00080000:0.0:1789427919.985087:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789427919.990950:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427919.990966:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.990977:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427919.990982:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.990991:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.991020:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:0.0:1789427919.991023:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427919.991029:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.991035:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede519044 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.991045:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427919.991047:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427919.991049:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789427920.099161:0:14668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427920.099170:0:14668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427920.099194:0:14668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789427920.099201:0:14668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427920.199846:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.200147:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931659648 00000100:00100000:1.0:1789427920.200161:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931659648 00000100:00080000:3.0:1789427920.200219:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427920.200243:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:1.0:1789427920.200254:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+23:12357:x1876350931659648:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427920.200279:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427920.200301:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede51904b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300dfa expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.200400:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede519052 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.200457:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede519052 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.200468:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede519052 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427920.200479:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789427920.200571:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede51904b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dfa expref: 26 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.200588:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede519052 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dfa expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.200596:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427920.200599:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789427920.200603:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46c00, rc 0) 00000100:00100000:1.0:1789427920.200728:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+25:12357:x1876350931659648:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 476us (893us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789427920.200736:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:2.0:1789427920.203552:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.203671:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931659776 00000100:00100000:3.0:1789427920.203738:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931659776 00000100:00100000:3.0:1789427920.203876:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 202 00000100:00100000:3.0:1789427920.203886:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+25:12357:x1876350931659776:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1789427920.203949:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.203964:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.203974:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.203987:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204000:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204007:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204080:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204088:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204096:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427920.204154:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204167:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204174:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204180:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204186:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427920.204190:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204198:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204215:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427920.204218:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427920.204223:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204230:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519060 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204242:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204248:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204253:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204258:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427920.204261:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204267:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204274:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9196a235fb00) 00010000:00010000:3.0:1789427920.204276:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427920.204279:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204284:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519067 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204306:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204311:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204317:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204322:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427920.204325:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204331:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204337:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:3.0:1789427920.204340:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427920.204342:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.204347:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51906e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427920.204438:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+25:12357:x1876350931659776:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 552us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.204445:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 202 00000100:00100000:1.0:1789427920.245523:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.245786:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660032 00000100:00100000:3.0:1789427920.245797:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660032 00000100:00100000:3.0:1789427920.245868:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:3.0:1789427920.245892:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+25:12360:x1876350931660032:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427920.245913:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.245933:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede519075 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e01 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246004:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246019:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246032:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246046:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246053:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246060:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246181:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246190:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246197:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427920.246216:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789427920.246290:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246298:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246304:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246309:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427920.246313:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246320:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246330:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427920.246334:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427920.246338:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246344:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51907c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246357:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246363:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246379:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246383:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427920.246386:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246392:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246400:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9196a235fb00) 00010000:00010000:3.0:1789427920.246403:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427920.246406:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246412:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede519083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246481:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede519075 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 28 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246497:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.246504:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:3.0:1789427920.246506:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427920.246509:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec800, rc 0) 00000100:00100000:3.0:1789427920.246571:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:12360:x1876350931660032:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 680us (1059us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789427920.246587:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:1.0:1789427920.250743:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.250798:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660160 00000100:00100000:2.0:1789427920.250808:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660160 00000100:00100000:2.0:1789427920.250927:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 204 00000100:00100000:2.0:1789427920.250938:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+27:12360:x1876350931660160:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1789427920.250999:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251016:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251028:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251061:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251069:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251086:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251093:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427920.251097:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251106:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251119:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:2.0:1789427920.251122:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427920.251128:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.251135:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519098 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.251263:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+27:12360:x1876350931660160:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 326us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.251271:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 204 00000100:00100000:1.0:1789427920.253130:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.253175:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660416 00000100:00100000:0.0:1789427920.253182:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660416 00000100:00100000:0.0:1789427920.253230:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:0.0:1789427920.253240:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:12360:x1876350931660416:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427920.253440:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+28:12360:x1876350931660416:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 202us (315us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789427920.253449:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1789427920.290561:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.290640:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660672 00000100:00100000:3.0:1789427920.290651:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660672 00000100:00100000:3.0:1789427920.290716:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:3.0:1789427920.290726:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+28:11892:x1876350931660672:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427920.290749:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.290780:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51909f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e08 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.290897:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.290912:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.290921:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.290953:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.290967:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 29 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427920.290980:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940096896:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427920.291081:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969899a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789427920.294559:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940096896:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427920.294600:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.294743:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.294797:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660800 00000100:00100000:2.0:1789427920.294805:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660800 00010000:00010000:2.0:1789427920.294842:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 30 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.294873:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:2.0:1789427920.294883:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+30:2397:x1876350931660800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427920.294899:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427920.294912:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 30 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.294936:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 30 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.294959:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51908a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e01 expref: 30 pid: 6483 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.294975:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:2.0:1789427920.294980:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.294989:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.294997:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.295119:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427920.295173:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+29:2397:x1876350931660800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 291us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.295238:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00010000:00010000:3.0:1789427920.296222:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.296233:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427920.296254:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789427920.296383:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51909f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 30 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.296402:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 29 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.296411:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:3.0:1789427920.296568:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789427920.296571:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ecc00, rc 0) 00000100:00100000:3.0:1789427920.296624:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+29:11892:x1876350931660672:12345-192.168.202.24@tcp:101:bash.0 Request processed in 5899us (6071us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789427920.296632:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:1.0:1789427920.299376:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.299655:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931660928 00000100:00100000:3.0:1789427920.299665:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931660928 00000100:00100000:3.0:1789427920.299889:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:3.0:1789427920.299900:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:11892:x1876350931660928:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427920.299923:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.299944:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede5190b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e0f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.299991:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede5190bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.300005:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede5190bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.300016:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede5190bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.300123:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede5190b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e0f expref: 31 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.300228:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede5190bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e0f expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.300237:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:3.0:1789427920.300240:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427920.300244:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed800, rc 0) 00000100:00100000:3.0:1789427920.300297:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+30:11892:x1876350931660928:12345-192.168.202.24@tcp:101:bash.0 Request processed in 398us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.300304:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:2.0:1789427920.302957:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.303051:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661184 00000100:00100000:0.0:1789427920.303060:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661184 00000100:00100000:0.0:1789427920.303164:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:0.0:1789427920.303175:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+30:11892:x1876350931661184:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:0.0:1789427920.303387:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.303403:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.303447:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427920.303492:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789427920.303515:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000955191e6 reply state 00000000e53cb441 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.303528:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.303535:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427920.303538:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427920.303543:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789427920.303582:0:8108:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789427920.303670:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+34:11892:x1876350931661184:12345-192.168.202.24@tcp:36:bash.0 Request processed in 497us (719us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789427920.303679:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:2.0:1789427920.305578:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000020:00080000:0.0:1789427920.305676:0:8108:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789427920.306163:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661312 00000100:00100000:0.0:1789427920.306171:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661312 00000100:00100000:3.0:1789427920.306221:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 208 00000100:00100000:3.0:1789427920.306233:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+34:11892:x1876350931661312:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427920.306252:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.306269:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5190c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e16 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.306338:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e16 expref: 35 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.306353:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5190c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e16 expref: 35 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.306372:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:3.0:1789427920.306375:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427920.306378:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec800, rc 0) 00000100:00100000:3.0:1789427920.306465:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+35:11892:x1876350931661312:12345-192.168.202.24@tcp:101:bash.0 Request processed in 234us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.306472:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 208 00010000:00010000:3.0:1789427920.306519:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427920.309177:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.309255:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661440 00000100:00100000:0.0:1789427920.309264:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661440 00000100:00100000:0.0:1789427920.309316:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1789427920.309327:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:11892:x1876350931661440:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789427920.309342:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427920.309372:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e1d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789427920.309397:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa880ce, atime: 0x6aa880cc, ctime: 0x6aa880ce, blocks: 0x8 00010000:00010000:0.0:1789427920.309450:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=264s v=(0 0) 00010000:00010000:0.0:1789427920.309455:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427920.309464:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.309482:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.309494:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f600, rc 0) 00000100:00100000:0.0:1789427920.309547:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:11892:x1876350931661440:12345-192.168.202.24@tcp:101:bash.0 Request processed in 222us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.309554:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:2.0:1789427920.311526:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.311612:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661568 00000100:00100000:0.0:1789427920.311621:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661568 00002000:00010000:0.0:1789427920.311655:0:8406:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789427920.311660:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8ed80 with x1876350931661568 ext(0->18446744073709551615) 00002000:00010000:0.0:1789427920.311669:0:8406:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfb8ed80. 00000100:00100000:0.0:1789427920.311712:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789427920.311722:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931661568:12345-192.168.202.24@tcp:10:bash.0 00002000:00010000:0.0:1789427920.311990:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789427920.311994:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789427918 -> 1789427919 00002000:00010000:0.0:1789427920.311997:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789427916 -> 1789427916 00002000:00010000:0.0:1789427920.312009:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789427918 -> 1789427919 00002000:00010000:0.0:1789427920.312011:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789427920.312068:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931661568:12345-192.168.202.24@tcp:10:bash.0 Request processed in 348us (550us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789427920.312076:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00002000:00010000:0.0:1789427920.312080:0:8406:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789427920.312083:0:8406:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfb8ed80 with x1876350931661568 ext(0->18446744073709551615) 00002000:00010000:0.0:1789427920.312088:0:8406:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfb8ed80. 00000100:00100000:3.0:1789427920.391103:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.391224:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661696 00000100:00100000:0.0:1789427920.391234:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661696 00000100:00100000:0.0:1789427920.391299:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:0.0:1789427920.391309:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+35:12374:x1876350931661696:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:0.0:1789427920.391382:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391400:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391458:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391476:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391484:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391490:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391574:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391584:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391591:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427920.391632:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391644:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391651:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391656:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391662:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427920.391665:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391673:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391684:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427920.391687:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427920.391692:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391704:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5190d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391719:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391725:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391731:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391736:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427920.391739:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391744:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391762:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91958354d200) 00010000:00010000:0.0:1789427920.391765:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427920.391768:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391773:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede5190de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391787:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391792:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391803:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391818:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427920.391821:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391827:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391834:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427920.391837:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427920.391839:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.391845:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede5190e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427920.392056:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+35:12374:x1876350931661696:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 747us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.392063:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:3.0:1789427920.433031:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.433184:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931661952 00000100:00100000:1.0:1789427920.433196:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931661952 00000100:00100000:1.0:1789427920.433261:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 210 00000100:00100000:1.0:1789427920.433272:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+35:12377:x1876350931661952:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427920.433292:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427920.433313:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5190ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e24 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433380:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433393:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433404:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433438:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433446:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433460:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433560:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519101 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433569:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519101 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433576:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519101 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427920.433586:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789427920.433649:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433657:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433664:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433670:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.433674:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433681:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433691:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427920.433695:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.433705:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433711:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5190f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433723:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433729:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433735:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433740:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.433743:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433748:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433767:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:1.0:1789427920.433769:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.433772:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433777:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5190fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433819:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede5190ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e24 expref: 38 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433843:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519101 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e24 expref: 37 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.433851:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:1.0:1789427920.433853:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789427920.433855:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47e00, rc 0) 00000100:00100000:1.0:1789427920.434123:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+37:12377:x1876350931661952:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 852us (1100us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789427920.434131:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 210 00000100:00100000:3.0:1789427920.437984:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.438070:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931662080 00000100:00100000:1.0:1789427920.438080:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931662080 00000100:00100000:1.0:1789427920.438150:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:1.0:1789427920.438161:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:12377:x1876350931662080:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:1.0:1789427920.438224:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.438241:0:8108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 37 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.438250:0:8108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.438285:0:8108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 37 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.438298:0:8108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 37 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.438328:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8108:1876350940097024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427920.438459:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427920.441379:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.441491:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931662336 00000100:00100000:0.0:1789427920.441500:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931662336 00000100:00100000:0.0:1789427920.441565:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:0.0:1789427920.441576:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+38:6154:x1876350931662336:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789427920.441889:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+39:6154:x1876350931662336:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 314us (517us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789427920.441897:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1789427920.442119:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8108:1876350940097024:192.168.202.24@tcp:104: 00010000:00010000:1.0:1789427920.442140:0:8108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.444690:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.444793:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931662464 00000100:00100000:0.0:1789427920.444803:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931662464 00010000:00010000:0.0:1789427920.444854:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 39 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427920.444895:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:0.0:1789427920.444904:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+39:2397:x1876350931662464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427920.444917:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427920.444923:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 39 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.444934:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 39 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.444955:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5190a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e08 expref: 39 pid: 6482 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.444974:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427920.444980:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.444990:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.444998:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.445036:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427920.445092:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+38:2397:x1876350931662464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 189us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.445113:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94 00010000:00010000:1.0:1789427920.445195:0:8108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445203:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445239:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445246:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445251:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445257:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.445261:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445267:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445274:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:1.0:1789427920.445282:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427920.445287:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.445292:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51910f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.445327:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+37:12377:x1876350931662080:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 7169us (7352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427920.445334:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:3.0:1789427920.447590:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.447705:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931662720 00000100:00100000:0.0:1789427920.447714:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931662720 00000100:00100000:0.0:1789427920.447770:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:0.0:1789427920.447779:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+37:12377:x1876350931662720:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789427920.447990:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+38:12377:x1876350931662720:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 210us (405us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789427920.447997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1789427920.534851:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.534995:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931662976 00000100:00100000:0.0:1789427920.535007:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931662976 00000100:00100000:0.0:1789427920.535079:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:0.0:1789427920.535090:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+38:12388:x1876350931662976:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1789427920.535114:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427920.535136:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519116 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e2b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535222:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535237:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535252:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535268:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535295:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535303:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535410:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede51912b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535468:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede51912b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535477:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede51912b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427920.535488:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789427920.535563:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535571:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535579:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535584:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427920.535589:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535597:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535622:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427920.535624:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427920.535630:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535636:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ea00/0x84fc867ede51911d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535649:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535655:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535660:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535664:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427920.535667:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535673:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535679:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91958354d200) 00010000:00010000:0.0:1789427920.535681:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427920.535685:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535690:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede519124 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535740:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519116 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e2b expref: 41 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535767:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede51912b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e2b expref: 40 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.535776:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427920.535778:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427920.535781:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ee00, rc 0) 00000100:00100000:0.0:1789427920.535901:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12388:x1876350931662976:12345-192.168.202.24@tcp:101:cat.0 Request processed in 813us (1060us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789427920.535908:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:3.0:1789427920.541800:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.542178:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931663232 00000100:00100000:0.0:1789427920.542190:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931663232 00000100:00100000:0.0:1789427920.542254:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1789427920.542264:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+40:12388:x1876350931663232:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1789427920.542667:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+41:12388:x1876350931663232:12345-192.168.202.24@tcp:35:cat.0 Request processed in 403us (876us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789427920.542676:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:3.0:1789427920.562840:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.562977:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931663488 00000100:00100000:1.0:1789427920.562987:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931663488 00000100:00100000:1.0:1789427920.563052:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 213 00000100:00100000:1.0:1789427920.563063:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+41:12389:x1876350931663488:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1789427920.563122:0:10064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789427920.563165:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5190c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e16 expref: 41 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563189:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1ee00/0x84fc867ede51912b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e2b expref: 40 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563202:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519101 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e24 expref: 39 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563213:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede5190bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e0f expref: 38 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563223:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:1.0:1789427920.563243:0:10064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427920.563265:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563279:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563290:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563305:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563313:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563319:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563402:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563657:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563668:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789427920.563907:0:10064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789427920.563918:0:10064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 265058502097ns, next at 266058499388ns, rc = 0 00010000:00010000:1.0:1789427920.563962:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563983:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563990:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.563999:0:10064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564005:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564012:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564072:0:10064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789427920.564091:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564097:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564103:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564109:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.564113:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564120:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564245:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:1.0:1789427920.564249:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789427920.564254:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564263:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede519147 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564279:0:10064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564286:0:10064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564292:0:10064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564297:0:10064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.564299:0:10064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564306:0:10064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564314:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427920.564316:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.564319:0:10064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564326:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519139 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427920.564346:0:10064:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004819a88f reply state 00000000ade82b9b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564358:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.564364:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:1.0:1789427920.564366:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427920.564369:0:10064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427920.564618:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+39:12389:x1876350931663488:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1554us (1786us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789427920.564626:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 213 00010000:00010000:0.0:1789427920.565462:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427920.565472:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.565480:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427920.565483:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.565505:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.565519:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427920.565522:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427920.565525:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.565530:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede51914e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.565544:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427920.565546:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427920.565548:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427920.616511:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.616605:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931663744 00000100:00100000:1.0:1789427920.616621:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931663744 00000100:00100000:1.0:1789427920.616685:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 214 00000100:00100000:1.0:1789427920.616694:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+39:12395:x1876350931663744:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1789427920.616718:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427920.616745:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519155 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e32 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616871:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616886:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616897:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616924:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616930:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.616936:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427920.617231:0:8108:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789427920.617354:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617362:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617369:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617397:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617405:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617411:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617447:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427920.617451:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617467:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617479:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427920.617481:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.617486:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617491:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede51915c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427920.617502:0:8108:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000064adc256 reply state 000000003b52d1dc transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617511:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617516:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:1.0:1789427920.617518:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789427920.617521:0:8108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789427920.617543:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede519155 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 42 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617554:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 41 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.617560:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:1.0:1789427920.617562:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427920.617564:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46e00, rc 0) 00000100:00100000:1.0:1789427920.617912:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+42:12395:x1876350931663744:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1216us (1408us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789427920.617926:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 214 00000100:00100000:2.0:1789427920.625171:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.625272:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931663872 00000100:00100000:3.0:1789427920.625282:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931663872 00000100:00100000:3.0:1789427920.625360:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1789427920.625372:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931663872:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427920.625391:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.625458:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e39 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427920.625487:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789427920.625509:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=265s v=(0 0) 00010000:00010000:3.0:1789427920.625514:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427920.625524:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 8 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.625543:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 8 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.625556:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000100:00100000:3.0:1789427920.625609:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931663872:12345-192.168.202.24@tcp:101:bash.0 Request processed in 240us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.625616:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00080000:2.0:1789427920.625680:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427920.628274:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.628567:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931664000 00000100:00100000:2.0:1789427920.628578:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931664000 00000100:00100000:2.0:1789427920.628674:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:2.0:1789427920.628698:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:12395:x1876350931664000:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427920.628715:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427920.628733:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e40 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.628782:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.628791:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427920.628796:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427920.628801:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.628847:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.628862:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.628876:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8401:1876350940097152:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427920.628981:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427920.631957:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8401:1876350940097152:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427920.631996:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 9 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.632018:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:3.0:1789427920.632083:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+9:12395:x1876350931664000:12345-192.168.202.24@tcp:101:bash.0 Request processed in 3399us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.632091:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:0.0:1789427920.634512:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.634606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931664128 00000100:00100000:1.0:1789427920.634616:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931664128 00010000:00010000:1.0:1789427920.634656:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.634707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:1.0:1789427920.634718:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688831450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931664128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427920.634734:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427920.634792:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.634819:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.634842:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519178 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e39 expref: 9 pid: 8400 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.634860:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427920.634865:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427920.634873:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.634884:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.635494:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.635515:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6513:1876350940097280:192.168.202.24@tcp:105: 00000100:00100000:1.0:1789427920.635594:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427920.640114:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.640193:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931664384 00000100:00100000:2.0:1789427920.640201:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931664384 00000100:00100000:2.0:1789427920.640280:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:2.0:1789427920.640291:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+42:12395:x1876350931664384:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1789427920.640729:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+43:12395:x1876350931664384:12345-192.168.202.24@tcp:35:bash.0 Request processed in 439us (622us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789427920.640738:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:0.0:1789427920.640937:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6513:1876350940097280:192.168.202.24@tcp:105: 00010000:00010000:0.0:1789427920.640958:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427920.640984:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688831450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931664128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6268us (6481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.640992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:2.0:1789427920.689098:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940097408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427920.689168:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427920.689410:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940097408 00000100:00100000:1.0:1789427920.689432:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940097408 00000100:00100000:1.0:1789427920.689483:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789427920.689490:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940097408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789427920.689520:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789427920.689575:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940097408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427920.689581:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789427920.689700:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940097408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427920.776024:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.776154:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931664512 00000100:00100000:2.0:1789427920.776165:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931664512 00000100:00100000:2.0:1789427920.776226:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:2.0:1789427920.776237:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+43:12411:x1876350931664512:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427920.776265:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427920.776289:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e47 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776356:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776371:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776382:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427920.776612:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789427920.776616:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427920.776635:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776679:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e47 expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776699:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e47 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.776708:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427920.776711:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427920.776714:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428c00, rc 0) 00000100:00100000:2.0:1789427920.776924:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+44:12411:x1876350931664512:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 688us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.776932:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:1.0:1789427920.785078:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.785161:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931664768 00000100:00100000:3.0:1789427920.785171:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931664768 00000100:00100000:3.0:1789427920.785235:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:3.0:1789427920.785246:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+44:12411:x1876350931664768:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427920.785266:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.785286:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519194 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e4e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.785395:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51919b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.785409:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51919b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.786011:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51919b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427920.786025:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789427920.786159:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519194 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e4e expref: 47 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.786181:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51919b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e4e expref: 46 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.786189:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:3.0:1789427920.786192:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427920.786196:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000100:00100000:3.0:1789427920.786312:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+46:12411:x1876350931664768:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1067us (1244us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789427920.786340:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:1.0:1789427920.792109:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427920.792161:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.792253:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665024 00000100:00100000:2.0:1789427920.792267:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665024 00000100:00100000:2.0:1789427920.792336:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:2.0:1789427920.792348:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+46:12411:x1876350931665024:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427920.792374:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427920.792396:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e55 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.792543:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.792559:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.792570:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427920.792601:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789427920.793055:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e55 expref: 49 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.793076:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e55 expref: 48 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.793085:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:2.0:1789427920.793088:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789427920.793092:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789427920.793149:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+48:12411:x1876350931665024:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 804us (1052us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789427920.793157:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:3.0:1789427920.793988:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665152 00000100:00100000:3.0:1789427920.793997:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665152 00000100:00100000:3.0:1789427920.794050:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1789427920.794059:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+48:2395:x1876350931665152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427920.794072:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427920.794089:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51919b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e4e expref: 48 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.794102:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:3.0:1789427920.794106:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427920.794150:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+47:2395:x1876350931665152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.794158:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1789427920.808534:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.808641:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665280 00000100:00100000:2.0:1789427920.808663:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665280 00000100:00100000:2.0:1789427920.808769:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1789427920.808781:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+8:2394:x1876350931665280:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:2.0:1789427920.808846:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.808869:0:13777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.808878:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427920.808882:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427920.808887:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.808954:0:13777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.808970:0:13777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 8 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.808984:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940097536:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427920.809089:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427920.812948:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13777:1876350940097536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789427920.812982:0:13777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.814140:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.814229:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665408 00000100:00100000:2.0:1789427920.814239:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665408 00002000:00100000:2.0:1789427920.814292:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff919583fc0e00 x1876350931665408/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:166/0 lens 504/0 e 0 to 0 dl 1789427931 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427920.814302:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919583fc0e00 with x1876350931665408 ext(0->8) 00010000:00010000:2.0:1789427920.814311:0:8405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 9 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.814328:0:8405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 9 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427920.814336:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919583fc0e00 00000100:00100000:2.0:1789427920.814392:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:2.0:1789427920.814402:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931665408:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:2.0:1789427920.817209:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931665408:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 2797us (3068us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789427920.817224:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00002000:00100000:2.0:1789427920.817238:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff919583fc0e00 x1876350931665408/t4294967309(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:166/0 lens 504/448 e 0 to 0 dl 1789427931 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427920.817248:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919583fc0e00 with x1876350931665408 ext(0->8) 00010000:00010000:2.0:1789427920.817258:0:8405:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.817277:0:8405:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427920.817285:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919583fc0e00 00000100:00100000:1.0:1789427920.822520:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.822614:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665536 00000100:00100000:2.0:1789427920.822624:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665536 00010000:00010000:2.0:1789427920.822800:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.822933:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:2.0:1789427920.822943:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2396:x1876350931665536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427920.822962:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789427920.822979:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789427920.822981:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789427920 00002000:00010000:2.0:1789427920.822998:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789427920 00002000:00010000:2.0:1789427920.823000:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789427920 00002000:00010000:2.0:1789427920.823002:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789427920.823009:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.823021:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.823041:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e35a846/0x84fc867ede51917f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e40 expref: 11 pid: 8401 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.823056:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427920.823060:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427920.823065:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.823074:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.823107:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427920.823162:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931665536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 221us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.823170:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96 00010000:00010000:3.0:1789427920.823444:0:13777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823455:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823486:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823495:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823514:0:13777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823520:0:13777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789427920.823527:0:13777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823535:0:13777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823547:0:13777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.823554:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eadb188/0x84fc867ede5191be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427920.823618:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+9:2394:x1876350931665280:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 14839us (15094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427920.823626:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:1.0:1789427920.827122:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427920.827537:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665792 00000100:00100000:3.0:1789427920.827547:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665792 00000100:00100000:3.0:1789427920.827593:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:3.0:1789427920.827605:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+47:12411:x1876350931665792:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:3.0:1789427920.827878:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e55 expref: 47 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427920.828088:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789427920.828117:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789427920.831024:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789427920.831100:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.831155:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 51 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.831165:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.831209:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 51 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.831226:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 51 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.831241:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940097664:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427920.831358:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427920.835370:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6486:1876350940097664:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427920.835401:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.836545:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427920.836647:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931665920 00000100:00100000:0.0:1789427920.836657:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931665920 00010000:00010000:0.0:1789427920.836708:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 52 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427920.836801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:0.0:1789427920.836815:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+52:2396:x1876350931665920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427920.836832:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427920.836839:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 52 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836856:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 52 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836878:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51916a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e32 expref: 52 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836896:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:0.0:1789427920.836902:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836913:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836934:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427920.836967:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427920.837022:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+51:2396:x1876350931665920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 213us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.837031:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00010000:00010000:1.0:1789427920.837275:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.837283:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427920.837404:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789427920.837556:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789427920.837675:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940097792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789427920.837725:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427920.837760:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427920.838328:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940097792 00000100:00100000:0.0:1789427920.838344:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940097792 00000100:00100000:0.0:1789427920.838407:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789427920.838436:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6486:x1876350940097792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427920.838540:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6486:x1876350940097792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427920.838547:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789427920.838588:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940097792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789427920.838730:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1789427920.838915:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940097920:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1789427920.839056:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427920.839089:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427920.839344:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427920.839389:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940097920 00000100:00100000:3.0:1789427920.839394:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940097920 00000100:00100000:3.0:1789427920.839457:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789427920.839466:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6486:x1876350940097920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789427920.839587:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6486:x1876350940097920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (497us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789427920.839593:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789427920.840161:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6486:1876350940097920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789427920.840216:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789427920.840260:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840283:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840290:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840295:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427920.840299:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840307:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840322:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:2.0:1789427920.840325:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789427920.840337:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.840344:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46800/0x84fc867ede5191c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427920.840478:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789427920.840539:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789427920.840552:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 265335136040ns, next at 266335133543ns, rc = 0 00000001:00080000:2.0:1789427920.840558:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789427920.840581:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff919581d4ef00) 00010000:00010000:2.0:1789427920.840583:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789427920.840591:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e55 expref: 55 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.841108:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+54:12411:x1876350931665792:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 13500us (13992us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789427920.841118:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000020:00080000:2.0:1789427920.841123:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789427920.846024:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.846113:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931666048 00000100:00100000:2.0:1789427920.846127:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931666048 00000100:00100000:2.0:1789427920.846198:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:2.0:1789427920.846212:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+54:12411:x1876350931666048:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427920.846237:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427920.846260:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5191cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e5c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.846325:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5191cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e5c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.846344:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5191cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e5c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.846365:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427920.846369:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427920.846372:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789427920.846483:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+55:12411:x1876350931666048:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 272us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.846491:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:1.0:1789427920.853571:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.853834:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931666304 00000100:00100000:2.0:1789427920.853845:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931666304 00000100:00100000:2.0:1789427920.853928:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:2.0:1789427920.853939:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+55:12411:x1876350931666304:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427920.854560:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+56:12411:x1876350931666304:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 621us (998us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789427920.854569:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1789427920.960659:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427920.960780:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931666432 00000100:00100000:2.0:1789427920.960791:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931666432 00000100:00100000:2.0:1789427920.960876:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:2.0:1789427920.960887:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+56:12421:x1876350931666432:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:2.0:1789427920.960984:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961003:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961015:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961026:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961038:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961045:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961127:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961169:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961177:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427920.961226:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961239:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961245:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961252:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961258:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427920.961262:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961270:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961291:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427920.961294:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427920.961299:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961305:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961327:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961333:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961344:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961350:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427920.961354:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961361:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961369:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:2.0:1789427920.961371:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427920.961374:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961381:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961396:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961402:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961408:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961480:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427920.961484:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961491:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961499:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427920.961502:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427920.961505:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427920.961511:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427920.961597:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+56:12421:x1876350931666432:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 711us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427920.961604:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:1.0:1789427921.001547:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.001695:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931666688 00000100:00100000:2.0:1789427921.001705:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931666688 00000100:00100000:2.0:1789427921.001777:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:2.0:1789427921.001788:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+56:12424:x1876350931666688:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427921.001820:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.001841:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e63 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001925:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001956:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001968:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001979:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001987:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.001993:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002111:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede5191fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002120:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede5191fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002128:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede5191fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.002145:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789427921.002233:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002240:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002245:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002256:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427921.002260:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002267:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002280:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427921.002283:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.002287:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002294:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede5191ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002307:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002312:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002318:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002323:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427921.002325:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002331:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002349:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:2.0:1789427921.002351:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.002354:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002361:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede5191f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002397:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede5191e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e63 expref: 59 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002410:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede5191fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e63 expref: 58 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.002948:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.002951:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427921.002955:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375cc00, rc 0) 00000100:00100000:2.0:1789427921.003028:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+58:12424:x1876350931666688:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1241us (1488us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789427921.003037:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:1.0:1789427921.007054:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427921.007183:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931666816 00000100:00100000:0.0:1789427921.007194:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931666816 00000100:00100000:0.0:1789427921.007266:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:0.0:1789427921.007277:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+58:12424:x1876350931666816:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:0.0:1789427921.007351:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007367:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007379:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007457:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007476:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007498:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007505:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427921.007510:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007518:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007530:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.007534:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427921.007539:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.007546:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51920b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.007622:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+58:12424:x1876350931666816:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 346us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.007630:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:0.0:1789427921.011070:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.011193:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667072 00000100:00100000:2.0:1789427921.011204:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667072 00000100:00100000:2.0:1789427921.011271:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:2.0:1789427921.011282:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+58:12424:x1876350931667072:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1789427921.011899:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+59:12424:x1876350931667072:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 616us (837us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789427921.011907:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:2.0:1789427921.112356:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427921.112812:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667328 00000100:00100000:3.0:1789427921.112826:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667328 00000100:00100000:3.0:1789427921.112897:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:3.0:1789427921.112908:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+59:12434:x1876350931667328:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789427921.112934:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.112937:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789427921.112964:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428c00/0x84fc867ede51918d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e47 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.112985:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:3.0:1789427921.112991:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427921.113005:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede519212 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e6a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.113128:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.113156:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.113167:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427921.113303:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789427921.113411:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede519212 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e6a expref: 61 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.113550:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e6a expref: 60 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.113559:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:3.0:1789427921.113562:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427921.113565:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec000, rc 0) 00000100:00100000:3.0:1789427921.113627:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+60:12434:x1876350931667328:12345-192.168.202.24@tcp:101:bash.0 Request processed in 721us (1282us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789427921.113635:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:1.0:1789427921.121897:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.121998:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667456 00000100:00100000:2.0:1789427921.122009:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667456 00000100:00100000:2.0:1789427921.122078:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 223 00000100:00100000:2.0:1789427921.122090:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+60:12434:x1876350931667456:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427921.122116:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.122139:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede519227 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e71 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.122363:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.122379:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.122391:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.122876:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427921.122951:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667584 00000100:00100000:0.0:1789427921.122959:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667584 00000100:00100000:0.0:1789427921.123008:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1789427921.123017:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+62:2397:x1876350931667584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427921.123030:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427921.123050:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e6a expref: 62 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.123084:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.123090:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427921.123159:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+61:2397:x1876350931667584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 143us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.123167:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00010000:00010000:2.0:1789427921.124107:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede519227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.124128:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.124136:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.124139:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427921.124141:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375c000, rc 0) 00000100:00100000:2.0:1789427921.124252:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+60:12434:x1876350931667456:12345-192.168.202.24@tcp:101:bash.0 Request processed in 2164us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.124270:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 223 00000100:00100000:1.0:1789427921.130286:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427921.130370:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667840 00000100:00100000:0.0:1789427921.130381:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667840 00000100:00100000:0.0:1789427921.130468:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 224 00000100:00100000:0.0:1789427921.130479:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+60:12434:x1876350931667840:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:0.0:1789427921.130545:0:10064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427921.130572:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede5191fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e63 expref: 60 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.130591:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.130597:0:10064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427921.130781:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.130796:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.130817:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427921.130861:0:10064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789427921.130885:0:10064:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000600690d6 reply state 000000009416f802 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.130917:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.130923:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.130926:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789427921.130929:0:10064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427921.131028:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+62:12434:x1876350931667840:12345-192.168.202.24@tcp:36:bash.0 Request processed in 550us (751us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789427921.131035:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 224 00000020:00080000:0.0:1789427921.131040:0:10064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789427921.135934:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.136039:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931667968 00000100:00100000:2.0:1789427921.136051:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931667968 00000100:00100000:2.0:1789427921.136114:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 225 00000100:00100000:2.0:1789427921.136125:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+62:12434:x1876350931667968:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789427921.136152:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.136179:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede51923c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e78 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136302:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136320:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136333:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.136366:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789427921.136371:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427921.136392:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136453:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede51923c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 64 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136476:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 63 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.136509:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.136512:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427921.136516:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375d200, rc 0) 00000100:00100000:2.0:1789427921.136596:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+63:12434:x1876350931667968:12345-192.168.202.24@tcp:101:bash.0 Request processed in 472us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.136603:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 225 00000100:00100000:3.0:1789427921.145147:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427921.145245:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668224 00000100:00100000:1.0:1789427921.145255:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668224 00000100:00100000:1.0:1789427921.145311:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:1.0:1789427921.145320:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+63:12434:x1876350931668224:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:1.0:1789427921.145570:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+64:12434:x1876350931668224:12345-192.168.202.24@tcp:35:bash.0 Request processed in 250us (432us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789427921.145578:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789427921.250953:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.251071:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668352 00000100:00100000:2.0:1789427921.251082:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668352 00000100:00100000:2.0:1789427921.251145:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:2.0:1789427921.251156:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+64:12440:x1876350931668352:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427921.251183:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.251205:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede51924a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e7f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251283:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251298:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251311:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.251596:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789427921.251600:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427921.251629:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251756:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede51924a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e7f expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251778:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e7f expref: 65 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.251787:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427921.251790:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427921.251793:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375c600, rc 0) 00000100:00100000:2.0:1789427921.251934:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931668352:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 778us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.251941:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:3.0:1789427921.264051:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.264153:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668480 00000100:00100000:2.0:1789427921.264163:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668480 00000100:00100000:2.0:1789427921.264228:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00100000:2.0:1789427921.264240:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931668480:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789427921.264264:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.264286:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede519258 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e86 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264363:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264379:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264389:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264477:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264487:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264495:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264572:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264583:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264590:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.264645:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789427921.264651:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427921.264668:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264681:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264688:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264694:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264710:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264716:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375ce00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427921.264721:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264727:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264738:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427921.264741:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.264758:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264764:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ce00/0x84fc867ede51925f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264778:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264784:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264790:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264796:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427921.264799:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264816:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264824:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:2.0:1789427921.264826:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.264830:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264836:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264861:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d800/0x84fc867ede519258 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264875:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 66 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.264883:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.264885:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427921.264888:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375c800, rc 0) 00000100:00100000:2.0:1789427921.265013:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+66:12440:x1876350931668480:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 774us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.265021:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00100000:3.0:1789427921.275086:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427921.275190:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668736 00000100:00100000:0.0:1789427921.275200:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668736 00000100:00100000:0.0:1789427921.275280:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:0.0:1789427921.275291:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+66:12440:x1876350931668736:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.275314:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.275341:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede519274 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e8d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275694:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275710:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275718:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275727:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275790:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.275938:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.275954:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940098048:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427921.276323:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.276335:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.276441:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940098176:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427921.277472:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427921.286553:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.289236:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668864 00000100:00100000:2.0:1789427921.289256:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668864 00010000:00010000:2.0:1789427921.289309:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 68 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.289391:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:2.0:1789427921.289402:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+68:2395:x1876350931668864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427921.289458:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427921.289467:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 68 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.289480:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 68 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.289504:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.289509:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.289519:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.289526:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427921.289587:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+68:2395:x1876350931668864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 187us (12117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.289794:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:3.0:1789427921.291483:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1789427921.291901:0:6483:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.24@tcp) returned -22 from blocking AST (req@0000000092acd195 x1876350940098048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.291923:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c800/0x84fc867ede51926d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e86 expref: 67 pid: 8108 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.291941:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940098048:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427921.291956:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6483:1876350940098176:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427921.291978:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.291998:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.292008:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.292018:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.292055:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931668992 00000100:00100000:2.0:1789427921.292062:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931668992 00010000:00010000:2.0:1789427921.292099:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.292139:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:2.0:1789427921.292149:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+67:2396:x1876350931668992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427921.292191:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427921.292198:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292223:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292243:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519243 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e78 expref: 67 pid: 6482 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292254:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427921.292258:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292267:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292275:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.292304:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427921.292363:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+66:2396:x1876350931668992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 216us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.292372:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99 00010000:00010000:0.0:1789427921.292380:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.292390:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427921.292409:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789427921.292732:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e000/0x84fc867ede519274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.292760:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 66 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.292767:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427921.292770:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789427921.292772:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f400, rc 0) 00000100:00100000:0.0:1789427921.292807:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+66:12440:x1876350931668736:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 17517us (17731us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789427921.292814:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:3.0:1789427921.303923:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427921.304111:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931669248 00000100:00100000:1.0:1789427921.304122:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931669248 00000100:00100000:1.0:1789427921.304190:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789427921.304200:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688831c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+66:12440:x1876350931669248:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:1.0:1789427921.304218:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427921.304243:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede5191cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e5c expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.304266:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427921.304272:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427921.304334:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688831c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931669248:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 135us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427921.304342:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1789427921.306876:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.306988:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931669376 00000100:00100000:2.0:1789427921.306998:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931669376 00000100:00100000:2.0:1789427921.307057:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00100000:2.0:1789427921.307067:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931669376:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:2.0:1789427921.307205:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.307222:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.307234:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427921.307344:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789427921.307459:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931669376:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 393us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.307478:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00100000:3.0:1789427921.313170:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427921.313374:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931669504 00000100:00100000:2.0:1789427921.313384:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931669504 00000100:00100000:2.0:1789427921.313494:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 230 00000100:00100000:2.0:1789427921.313509:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+65:12440:x1876350931669504:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789427921.313644:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.313667:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e94 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313734:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313758:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 66 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313790:0:6482:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313814:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 66 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313829:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:3.0:1789427921.313833:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427921.313837:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 66 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.313846:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed800, rc 0) 00000100:00100000:3.0:1789427921.313909:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+66:12440:x1876350931669504:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 405us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.313916:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 230 00010000:00010000:0.0:1789427921.329599:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427922.032629:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427922.032640:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427922.032689:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789427922.032698:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427922.032861:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940098304:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427922.032991:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427922.045072:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.045266:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931669632 00000100:00100000:0.0:1789427922.045298:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931669632 00000100:00100000:0.0:1789427922.045407:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 231 00000100:00100000:0.0:1789427922.045466:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931669632:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789427922.045507:0:6483:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789427922.045675:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931669632:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 257us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.045684:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 231 00000100:00080000:3.0:1789427922.045921:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427922.046231:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940098304:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789427922.075529:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.075616:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931669760 00000100:00100000:1.0:1789427922.075635:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931669760 00000100:00100000:1.0:1789427922.075782:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 232 00000100:00100000:1.0:1789427922.075793:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+66:12441:x1876350931669760:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789427922.076289:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076312:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076327:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076346:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076354:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076361:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076388:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076397:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076403:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427922.076502:0:8108:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789427922.076507:0:8108:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427922.076521:0:8108:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076543:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076550:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076558:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076564:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.076569:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076577:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076590:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427922.076593:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.076599:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076607:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede519297 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076622:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076628:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076634:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076645:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.076648:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076654:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076664:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9196988e2100) 00010000:00010000:1.0:1789427922.076666:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.076669:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076728:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51929e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076753:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076759:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076764:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076769:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.076772:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076778:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076796:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427922.076799:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.076803:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.076808:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.076982:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+66:12441:x1876350931669760:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 1187us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.076991:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 232 00000100:00100000:1.0:1789427922.091063:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.091194:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931670016 00000100:00100000:3.0:1789427922.091205:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931670016 00000100:00100000:3.0:1789427922.091268:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 233 00000100:00100000:3.0:1789427922.091280:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+66:12441:x1876350931670016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.091301:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427922.091324:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5192ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300e9b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091704:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091722:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091744:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427922.091758:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789427922.091855:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091863:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091870:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091893:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.091897:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091904:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091918:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427922.091921:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789427922.091926:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091931:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091977:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5192ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e9b expref: 68 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.091987:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:1.0:1789427922.091989:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427922.091993:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede5192ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e9b expref: 68 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.092006:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec800, rc 0) 00000100:00100000:1.0:1789427922.092072:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 795us (1019us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789427922.092079:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 233 00000100:00100000:3.0:1789427922.098022:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.098192:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931670144 00000100:00100000:1.0:1789427922.098216:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931670144 00000100:00100000:1.0:1789427922.098278:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:1.0:1789427922.098289:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670144:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789427922.098328:0:6484:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789427922.098482:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670144:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 193us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.098490:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:0.0:1789427922.110087:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.112812:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931670400 00000100:00100000:1.0:1789427922.112829:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931670400 00000100:00100000:1.0:1789427922.112913:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 235 00000100:00100000:1.0:1789427922.112924:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427922.112946:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427922.112949:0:10064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789427922.112977:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519251 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e7f expref: 67 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.112997:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427922.113003:0:10064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427922.113017:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ea2 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427922.113523:0:10064:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789427922.113667:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede5192c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.113682:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede5192c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.113707:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede5192c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.113988:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46000/0x84fc867ede5192c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea2 expref: 69 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.114005:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede5192c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea2 expref: 68 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.114013:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196988e2100) 00010000:00010000:1.0:1789427922.114015:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427922.114018:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47400, rc 0) 00000100:00100000:1.0:1789427922.114086:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+68:12441:x1876350931670400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1163us (4009us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789427922.114095:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 235 00000100:00100000:3.0:1789427922.120905:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.121317:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931670656 00000100:00100000:1.0:1789427922.121335:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931670656 00000100:00100000:1.0:1789427922.121409:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:1.0:1789427922.121440:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688435850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+68:12441:x1876350931670656:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789427922.121502:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427922.121530:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede5192c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea2 expref: 68 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121549:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196988e2100) 00010000:00010000:1.0:1789427922.121560:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427922.121581:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121609:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121621:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121636:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121651:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121658:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121704:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121712:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121720:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121726:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.121731:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121752:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121761:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:1.0:1789427922.121771:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.121776:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121782:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46200/0x84fc867ede5192d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121792:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121798:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121804:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121810:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789427922.121813:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121819:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121827:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xddc7eb81 (ffff9196988e2e00) 00010000:00010000:1.0:1789427922.121830:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.121833:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.121839:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47800/0x84fc867ede5192dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xddc7eb81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.121937:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688435850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670656:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 499us (1052us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427922.121951:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:2.0:1789427922.126657:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.127060:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931670784 00000100:00100000:3.0:1789427922.127080:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931670784 00000100:00100000:3.0:1789427922.127172:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:3.0:1789427922.127187:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+67:12441:x1876350931670784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.127227:0:8108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427922.127257:0:8108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede5192e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ea9 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127301:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127326:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127340:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127509:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede5192e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 69 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127547:0:8108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 68 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.127556:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:3.0:1789427922.127560:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427922.127564:0:8108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ecc00, rc 0) 00000100:00100000:3.0:1789427922.127641:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+68:12441:x1876350931670784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 459us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.127650:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:0.0:1789427922.133179:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.133389:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671040 00000100:00100000:3.0:1789427922.133402:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671040 00000100:00100000:2.0:1789427922.133731:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00100000:2.0:1789427922.133761:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+68:12441:x1876350931671040:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789427922.133969:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.133988:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.134000:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427922.134171:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789427922.134182:0:6483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 266628765851ns, next at 267628763151ns, rc = 0 00000004:00010000:2.0:1789427922.134228:0:6483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000347553ca reply state 00000000cd170a5a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.134240:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.134248:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:2.0:1789427922.134250:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789427922.134254:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427922.134361:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+70:12441:x1876350931671040:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 611us (1277us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789427922.134368:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00100000:2.0:1789427922.139083:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.139302:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671168 00000100:00100000:0.0:1789427922.139315:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671168 00000100:00100000:0.0:1789427922.139390:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00100000:0.0:1789427922.139403:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+70:12441:x1876350931671168:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427922.139449:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427922.139473:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300eb0 expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.139586:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 71 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.139600:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 71 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.139619:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.139621:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427922.139625:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f200, rc 0) 00000100:00100000:0.0:1789427922.139833:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+71:12441:x1876350931671168:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 432us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.139841:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00100000:3.0:1789427922.143750:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.144889:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671296 00000100:00100000:1.0:1789427922.144905:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671296 00000100:00100000:1.0:1789427922.145063:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:1.0:1789427922.145076:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+9:2396:x1876350931671296:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789427922.145294:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427922.145967:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931671296:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 891us (2240us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789427922.145977:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:3.0:1789427922.149180:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.149532:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671552 00000100:00100000:1.0:1789427922.149545:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671552 00000100:00100000:0.0:1789427922.149843:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:0.0:1789427922.149860:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+71:12441:x1876350931671552:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427922.150396:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+72:12441:x1876350931671552:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 539us (1230us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789427922.150406:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1789427922.154479:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.154782:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671808 00000100:00100000:1.0:1789427922.154854:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671808 00000100:00100000:0.0:1789427922.155119:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 240 00000100:00100000:0.0:1789427922.155133:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+72:12441:x1876350931671808:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789427922.155296:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+72:12441:x1876350931671808:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 166us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.155305:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 240 00000100:00100000:3.0:1789427922.158538:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.158720:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931671936 00000100:00100000:2.0:1789427922.158732:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931671936 00000100:00100000:2.0:1789427922.158818:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 241 00000100:00100000:2.0:1789427922.158831:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+72:12441:x1876350931671936:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427922.158879:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427922.158907:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519300 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300eb7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159110:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159130:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159145:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427922.159557:0:6483:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789427922.159587:0:6483:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159621:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519300 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb7 expref: 74 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159643:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb7 expref: 73 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.159653:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:2.0:1789427922.159656:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789427922.159773:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375ca00, rc 0) 00000100:00100000:2.0:1789427922.160104:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+73:12441:x1876350931671936:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1275us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.160113:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 241 00000100:00100000:2.0:1789427922.163513:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.163692:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672064 00000100:00100000:3.0:1789427922.163706:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672064 00000100:00100000:3.0:1789427922.163786:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:3.0:1789427922.163809:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+10:2396:x1876350931672064:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.163833:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427922.163858:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ebe expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427922.163894:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880d1, blocks: 0x0 00010000:00010000:3.0:1789427922.163919:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=266s v=(0 0) 00010000:00010000:3.0:1789427922.163924:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.164101:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 11 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.164126:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 11 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.164142:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000100:00100000:3.0:1789427922.164291:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+11:2396:x1876350931672064:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 484us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.164300:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:2.0:1789427922.170229:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.170447:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672320 00000100:00100000:0.0:1789427922.170460:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672320 00000100:00100000:0.0:1789427922.170536:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 242 00000100:00100000:0.0:1789427922.170549:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+73:12441:x1876350931672320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789427922.170686:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+73:12441:x1876350931672320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 140us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.170695:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 242 00000100:00100000:0.0:1789427922.174921:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.175675:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672448 00000100:00100000:3.0:1789427922.175690:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672448 00000100:00100000:3.0:1789427922.175789:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:3.0:1789427922.175809:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+11:12441:x1876350931672448:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.175855:0:13777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427922.175877:0:13777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ec5 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.175917:0:13777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.175926:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.175931:0:13777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.176274:0:13777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 12 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.176362:0:13777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.176393:0:13777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.176406:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584561180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13777:1876350940098432:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427922.181638:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdace40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427922.186366:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.186546:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584561180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13777:1876350940098432:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427922.186592:0:13777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 12 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.186638:0:13777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec800, rc 0) 00000100:00100000:0.0:1789427922.186745:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+12:12441:x1876350931672448:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 10931us (11830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.186757:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:3.0:1789427922.187510:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672576 00000100:00100000:3.0:1789427922.187522:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672576 00010000:00010000:3.0:1789427922.187900:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.188046:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:3.0:1789427922.188058:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+12:2397:x1876350931672576:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427922.188077:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427922.188106:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.188122:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.188166:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede51930e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ebe expref: 12 pid: 8401 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.188187:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.188192:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.188226:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 11 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.188238:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 11 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.188283:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 11 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.188301:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940098560:192.168.202.24@tcp:105: 00000100:00100000:3.0:1789427922.188547:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdace40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427922.194809:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6470:1876350940098560:192.168.202.24@tcp:105: 00010000:00010000:3.0:1789427922.194847:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427922.195203:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2397:x1876350931672576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7144us (8850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.195229:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:1.0:1789427922.200670:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.200844:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672704 00000100:00100000:2.0:1789427922.200859:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672704 00002000:00100000:2.0:1789427922.200930:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff91958453ea00 x1876350931672704/t0(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:168/0 lens 504/0 e 0 to 0 dl 1789427933 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427922.200955:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958453ea00 with x1876350931672704 ext(0->12) 00002000:00010000:2.0:1789427922.200962:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958453ea00 00000100:00100000:2.0:1789427922.201000:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789427922.201012:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+11:2396:x1876350931672704:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789427922.205047:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f916dfa-5c35-44f7-8247-070d65680205+13:2396:x1876350931672704:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 2292us (2656us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789427922.205071:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00002000:00100000:2.0:1789427922.205091:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff91958453ea00 x1876350931672704/t4294967321(0) o4->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:168/0 lens 504/448 e 0 to 0 dl 1789427933 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427922.205104:0:8407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91958453ea00 with x1876350931672704 ext(0->12) 00002000:00010000:2.0:1789427922.205113:0:8407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91958453ea00 00000100:00100000:2.0:1789427922.217307:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.218013:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672832 00000100:00100000:0.0:1789427922.218028:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672832 00000100:00100000:0.0:1789427922.218107:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 243 00000100:00100000:0.0:1789427922.218119:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+73:12441:x1876350931672832:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789427922.221306:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789427922.221324:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789427922.221359:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789427922.221381:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196a05e5780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789427922.221386:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bcb30400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9196a05e5840 00000020:00080000:1.0:1789427922.221389:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bcb30300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919684c4d800 00000004:00080000:1.0:1789427922.221447:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789427922.221482:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196aea2e0c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789427922.221486:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bbd74600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9196aea2e3c0 00000020:00080000:1.0:1789427922.221488:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bbd74c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919698b33e00 00000020:00080000:1.0:1789427922.221524:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1789427922.221633:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940098816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427922.221928:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427922.221997:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427922.222002:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940098688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789427922.222020:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427922.222047:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940098816 00000020:00080000:1.0:1789427922.222058:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789427922.222069:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940098816 00000100:00100000:3.0:1789427922.222360:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427922.222383:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940098944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789427922.222385:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940098688 00000100:00100000:2.0:1789427922.222394:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940098688 00000100:00100000:3.0:1789427922.222488:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789427922.223029:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427922.223131:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940098944 00000100:00100000:2.0:1789427922.223137:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940098944 00000100:00100000:2.0:1789427922.223191:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789427922.223206:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940098816:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789427922.223214:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1789427922.223378:0:8902:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789427922.223384:0:8902:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789427921 00002000:00010000:2.0:1789427922.223388:0:8902:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789427922.223390:0:8902:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789427921 -> 1789427921 00002000:00010000:2.0:1789427922.223394:0:8902:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789427922.223517:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3616:x1876350940098816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (1587us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789427922.223527:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1789427922.223575:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9196bfaab480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789427922.223585:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940098816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427922.223651:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789427922.223666:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940098688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789427922.223685:0:8902:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789427922.223708:0:8902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.223747:0:8902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.223759:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789427922.223764:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427922.223770:0:8902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.223812:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1789427922.223826:0:8902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.223838:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3614:x1876350940098944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789427922.223865:0:8902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 12 pid: 8402 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.223882:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8902:1876350940099072:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427922.223969:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688bf4240 going to sleep for 11 seconds 00002000:00080000:3.0:1789427922.224458:0:8400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789427922.224496:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa880d0, atime: 0x6aa880d0, ctime: 0x6aa880d0, blocks: 0x8 00010000:00010000:3.0:1789427922.224505:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225325:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225341:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225349:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225356:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.225362:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225398:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.225410:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=266s v=(0 0) 00010000:00010000:3.0:1789427922.225481:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.225489:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225665:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9196a05ef700) 00010000:00010000:0.0:1789427922.225669:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.225678:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225700:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46a00/0x84fc867ede51901a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225772:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225780:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225787:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225793:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.225796:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225802:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225811:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9196a235f000) 00010000:00010000:0.0:1789427922.225813:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.225817:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225824:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f000/0x84fc867ede5190c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225843:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225850:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225864:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225870:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.225873:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225881:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225892:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:0.0:1789427922.225895:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.225899:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225905:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47000/0x84fc867ede519140 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225923:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225929:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225936:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225942:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.225946:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225966:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225975:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff919581d4e300) 00010000:00010000:0.0:1789427922.225978:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.225981:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.225988:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47e00/0x84fc867ede519163 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226022:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226030:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226037:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226043:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.226047:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226053:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.226064:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427922.226067:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.226071:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.227626:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.227655:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.227665:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.227688:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427922.227962:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3614:x1876350940098944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4135us (5471us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789427922.227973:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1789427922.228524:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427922.228533:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.228542:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789427922.228547:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.228556:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.228576:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.228584:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede519323 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.228615:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427922.228616:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427922.228618:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789427922.232905:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919584560e00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789427922.232921:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940098944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789427922.233956:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+23:12441:x1876350931672832:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 15833us (16657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.233967:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 243 00000001:00080000:2.0:1789427922.235106:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789427922.235118:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1789427922.276093:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede519235 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276140:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276148:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276155:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276163:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.276178:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276188:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276210:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.276214:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789427922.276221:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.276227:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede5192f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.284661:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8902:1876350940099072:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427922.284705:0:8902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.303086:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.303136:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.303250:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673088 00000100:00100000:2.0:1789427922.303251:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931672960 00000100:00100000:2.0:1789427922.303265:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931672960 00000100:00100000:0.0:1789427922.303267:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673088 00010000:00010000:2.0:1789427922.303319:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 14 pid: 8402 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.303356:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:0.0:1789427922.303371:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+14:2394:x1876350931673088:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789427922.303382:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:2.0:1789427922.303396:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+14:2396:x1876350931672960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427922.303462:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427922.303470:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 14 pid: 8402 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.303486:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 14 pid: 8402 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.303529:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede5190d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e1d expref: 14 pid: 8402 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.303547:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427922.303552:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427922.303558:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.303569:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.303604:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427922.303659:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f916dfa-5c35-44f7-8247-070d65680205+13:2396:x1876350931672960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 266us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.303667:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101 00010000:00010000:0.0:1789427922.303961:0:8902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.303977:0:8902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.303990:0:8902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.303999:0:8902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.304036:0:8902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789427922.304270:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3616:x1876350940098688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80606us (82245us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789427922.304279:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1789427922.304595:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9196bfaaa300/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789427922.304605:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940098688:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789427922.304888:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427922.304899:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.304912:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789427922.304917:0:9487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.304929:0:9487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.304968:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.304977:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000566ba7/0x84fc867ede51931c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.305001:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427922.305004:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427922.305006:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789427922.316695:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1789427922.316713:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1789427922.317106:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931673088:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 13733us (13963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.317117:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:1.0:1789427922.325250:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.325453:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673344 00000100:00100000:2.0:1789427922.325464:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673344 00000100:00100000:2.0:1789427922.325540:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 244 00000100:00100000:2.0:1789427922.325550:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:12441:x1876350931673344:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789427922.325606:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427922.325632:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375ca00/0x84fc867ede519307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb7 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.325650:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:2.0:1789427922.325656:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427922.325821:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.325836:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.325846:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427922.326249:0:6483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000005942bdd reply state 0000000056fcf424 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.326262:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.326269:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:2.0:1789427922.326271:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789427922.326274:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427922.326571:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:12441:x1876350931673344:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1021us (1328us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789427922.326579:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 244 00000100:00100000:2.0:1789427922.340405:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.340534:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673472 00000100:00100000:3.0:1789427922.340544:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673472 00000100:00100000:3.0:1789427922.340605:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:3.0:1789427922.340615:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931673472:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789427922.340782:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789427922.340786:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789427921 -> 1789427920 00002000:00010000:3.0:1789427922.340789:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789427920 00002000:00010000:3.0:1789427922.340791:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789427921 -> 1789427920 00002000:00010000:3.0:1789427922.340793:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789427922.340851:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+8:2394:x1876350931673472:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 237us (456us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789427922.341046:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:2.0:1789427922.350855:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.352122:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673728 00000100:00100000:1.0:1789427922.352141:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673728 00000100:00100000:1.0:1789427922.352221:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 245 00000100:00100000:1.0:1789427922.352233:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+22:12441:x1876350931673728:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789427922.352304:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.352323:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 22 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.352332:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.352368:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 22 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.352382:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 22 pid: 8108 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.352397:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940099200:192.168.202.24@tcp:104: 00000100:00100000:1.0:1789427922.352555:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196aea2e480 going to sleep for 11 seconds 00000040:00080000:0.0:1789427922.353206:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789427922.354385:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427922.362917:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940099200:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789427922.363033:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.363408:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673856 00000100:00100000:0.0:1789427922.363469:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673856 00010000:00010000:0.0:1789427922.363528:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 23 pid: 8108 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.363562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:0.0:1789427922.363586:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+23:2397:x1876350931673856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427922.363603:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427922.363611:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 23 pid: 8108 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363624:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 23 pid: 8108 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363647:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede5192eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ea9 expref: 23 pid: 8108 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363666:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.363671:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363681:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363689:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.363707:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427922.363782:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+22:2397:x1876350931673856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 197us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.363790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102 00010000:00010000:1.0:1789427922.364067:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365347:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365359:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365398:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365405:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365412:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365472:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789427922.365476:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365483:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365497:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:2.0:1789427922.365501:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789427922.365707:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.365716:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede519331 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.366475:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+21:12441:x1876350931673728:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 14239us (15629us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789427922.366486:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 245 00000100:00100000:0.0:1789427922.377835:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.379559:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931673984 00000100:00100000:3.0:1789427922.379572:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931673984 00000100:00100000:3.0:1789427922.379633:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1789427922.379644:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+8:2394:x1876350931673984:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.379690:0:8902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.379710:0:8902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 8 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.379719:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427922.379768:0:8902:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427922.379772:0:8902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.379820:0:8902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 8 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.379836:0:8902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 8 pid: 13777 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.379849:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584561500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8902:1876350940099328:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427922.380399:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdace40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427922.386893:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584561500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8902:1876350940099328:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427922.386949:0:8902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.400878:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.405613:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931674112 00000100:00100000:3.0:1789427922.405630:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931674112 00010000:00010000:3.0:1789427922.405684:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 9 pid: 13777 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.405747:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:3.0:1789427922.405758:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+9:2397:x1876350931674112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427922.405774:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427922.405808:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 9 pid: 13777 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.405823:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 9 pid: 13777 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.405847:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6bc81a4/0x84fc867ede519315 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ec5 expref: 9 pid: 13777 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.405891:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427922.405895:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427922.405901:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.405912:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.406233:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427922.406305:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931674112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 548us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.406314:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00010000:00010000:0.0:1789427922.411666:0:8902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411688:0:8902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411720:0:8902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411730:0:8902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411750:0:8902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411757:0:8902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427922.411761:0:8902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411769:0:8902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411823:0:8902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.411831:0:8902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81c9259/0x84fc867ede519338 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.412103:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931673984:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 32455us (34276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.412122:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:0.0:1789427922.414785:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.414866:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931674368 00000100:00100000:3.0:1789427922.414877:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931674368 00000100:00100000:3.0:1789427922.414932:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 246 00000100:00100000:3.0:1789427922.414942:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+21:12441:x1876350931674368:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427922.415016:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.415033:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.415044:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.415091:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.415117:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 21 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.415133:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099456:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427922.415214:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdace40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427922.421160:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427922.421298:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931674496 00000100:00100000:1.0:1789427922.421308:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931674496 00010000:00010000:1.0:1789427922.421351:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 22 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.421396:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:1.0:1789427922.421407:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:2396:x1876350931674496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427922.421455:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427922.421463:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 22 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421477:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 22 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421499:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427922.421516:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421529:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421538:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421546:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.421578:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427922.421629:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:2396:x1876350931674496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 224us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.421636:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104 00010000:00010000:3.0:1789427922.422328:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c000/0x84fc867ede51922e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e71 expref: 21 pid: 6484 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.422347:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099456:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427922.422366:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422374:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422380:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422595:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422608:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 21 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422616:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422645:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 21 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.422667:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 21 pid: 10064 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.422681:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099584:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789427922.422872:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684c7f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427922.442005:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.442226:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099584:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789427922.442258:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.442336:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931674624 00000100:00100000:0.0:1789427922.442344:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931674624 00010000:00010000:0.0:1789427922.442381:0:7887:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 22 pid: 10064 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.442455:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 105 00000100:00100000:0.0:1789427922.442466:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+22:2397:x1876350931674624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427922.442481:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427922.442488:0:7887:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 22 pid: 10064 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442501:0:7887:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 22 pid: 10064 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442533:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede5192f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eb0 expref: 22 pid: 10064 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442548:0:7887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.442567:0:7887:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442577:0:7887:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442584:0:7887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.442614:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427922.442662:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2f916dfa-5c35-44f7-8247-070d65680205+21:2397:x1876350931674624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 198us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.442669:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 105 00010000:00010000:3.0:1789427922.442808:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.442816:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427922.442927:0:6482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789427922.443037:0:6482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789427922.443188:0:6482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789427922.443272:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6482:1876350940099712:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789427922.443319:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427922.443356:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbdace40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427922.444002:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940099712 00000100:00100000:0.0:1789427922.444008:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940099712 00000100:00100000:0.0:1789427922.444043:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789427922.444051:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6482:x1876350940099712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789427922.444197:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6482:x1876350940099712:12345-0@lo:1000:mdt00_000.0 Request processed in 146us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.444205:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789427922.444365:0:6482:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789427922.444371:0:6482:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1789427922.444387:0:6482:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9196bfaab480, transno 4294967322 00000004:00080000:3.0:1789427922.444401:0:6482:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9196bfaaa300, transno 4294967323 00000100:00100000:3.0:1789427922.444408:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6482:1876350940099712:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789427922.444565:0:6482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1789427922.444614:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6482:1876350940099840:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789427922.444644:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427922.444664:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968570d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427922.445035:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940099840 00000100:00100000:0.0:1789427922.445041:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940099840 00000100:00100000:2.0:1789427922.445240:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427922.445251:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6482:x1876350940099840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789427922.445370:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6482:x1876350940099840:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (724us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789427922.445377:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789427922.445461:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6482:1876350940099840:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789427922.445494:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445504:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445523:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445539:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.445544:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445551:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445565:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.445568:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427922.445572:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445577:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede519346 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445601:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445606:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445612:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445617:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.445619:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445624:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445641:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427922.445643:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427922.445650:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445660:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445668:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.445693:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.445705:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099968:192.168.202.24@tcp:105: 00000100:00100000:0.0:1789427922.445947:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789427922.448615:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.448779:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6482:1876350940099968:192.168.202.24@tcp:105: 00010000:00010000:0.0:1789427922.448817:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448828:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375d200/0x84fc867ede519289 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448871:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448885:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448909:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448921:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448928:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448934:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448939:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.448943:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448949:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448959:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427922.448962:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.448966:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448972:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51934d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448982:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.448988:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.449002:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.449007:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.449010:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.449016:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.449025:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427922.449027:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427922.449030:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.449036:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51933f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.449348:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:12441:x1876350931674368:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 34405us (34570us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789427922.449358:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 246 00000020:00080000:0.0:1789427922.449364:0:6482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789427922.449524:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427922.449528:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427922.450248:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789427922.450260:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427922.457654:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931674752 00000100:00100000:3.0:1789427922.457671:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931674752 00000100:00100000:2.0:1789427922.457926:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1789427922.457938:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:12440:x1876350931674752:12345-192.168.202.24@tcp:49:lfs.0 00000100:00100000:2.0:1789427922.458066:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:12440:x1876350931674752:12345-192.168.202.24@tcp:49:lfs.0 Request processed in 130us (9459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.458269:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1789427922.460830:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.460884:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.460979:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675264 00000100:00100000:0.0:1789427922.460989:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675264 00000100:00100000:0.0:1789427922.461037:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:0.0:1789427922.461046:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:12440:x1876350931675264:12345-192.168.202.24@tcp:58:lfs.0 00000040:00080000:0.0:1789427922.461220:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789427922.461283:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+24:12440:x1876350931675264:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 238us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.461304:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:3.0:1789427922.466663:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675008 00000100:00100000:3.0:1789427922.466678:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675008 00000100:00100000:2.0:1789427922.471831:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:2.0:1789427922.471845:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+24:12441:x1876350931675008:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789427922.472686:0:6485:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789427922.472723:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789427922.472966:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.472983:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.472995:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.473004:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.473011:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.473017:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.473165:0:6485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789427922.473488:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+26:12441:x1876350931675008:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1642us (12600us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789427922.473499:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000020:00080000:2.0:1789427922.473572:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789427922.481226:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427922.481243:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.481254:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789427922.481258:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.481268:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.481288:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:0.0:1789427922.481291:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427922.481296:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.481303:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c600/0x84fc867ede519354 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.481322:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427922.481325:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427922.481326:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427922.495598:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.495753:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675392 00000100:00100000:0.0:1789427922.495763:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675392 00000100:00100000:0.0:1789427922.495822:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:0.0:1789427922.495831:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+26:12443:x1876350931675392:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789427922.495861:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427922.495883:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51935b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ecc expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.495968:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.495983:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.495994:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496008:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496016:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496023:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496102:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496112:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496121:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496151:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.496177:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 27 pid: 6483 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.496190:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940100096:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789427922.496306:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789427922.498756:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427922.498832:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6484:1876350940100096:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789427922.498869:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.499015:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675648 00000100:00100000:2.0:1789427922.499022:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675648 00000100:00100000:2.0:1789427922.499092:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:2.0:1789427922.499103:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+28:6154:x1876350931675648:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789427922.499470:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:6154:x1876350931675648:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 367us (725us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789427922.499478:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:2.0:1789427922.502459:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427922.502535:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675776 00000100:00100000:3.0:1789427922.502550:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675776 00010000:00010000:3.0:1789427922.502607:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 29 pid: 6483 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.502703:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:1.0:1789427922.502721:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688833850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:2397:x1876350931675776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427922.502751:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427922.502764:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 29 pid: 6483 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502791:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 29 pid: 6483 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502815:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede51927b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e8d expref: 29 pid: 6483 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502833:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427922.502838:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502847:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502868:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.502963:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427922.503029:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688833850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f916dfa-5c35-44f7-8247-070d65680205+28:2397:x1876350931675776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 315us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.503038:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 106 00010000:00010000:0.0:1789427922.503164:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503173:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427922.503235:0:6484:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789427922.503239:0:6484:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789427922.503259:0:6484:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503270:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503278:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503284:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503304:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503310:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.503313:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503320:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503329:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:0.0:1789427922.503331:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.503335:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503341:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede519362 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503352:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503358:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503363:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503368:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427922.503372:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503386:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503395:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91958354d200) 00010000:00010000:0.0:1789427922.503398:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.503401:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503407:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e600/0x84fc867ede519369 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503476:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f200/0x84fc867ede51935b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ecc expref: 28 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503490:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ecc expref: 27 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.503497:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427922.503499:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427922.503501:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fe00, rc 0) 00000100:00100000:0.0:1789427922.503762:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+27:12443:x1876350931675392:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 7929us (8172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.503771:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:3.0:1789427922.739170:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427922.739193:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940100224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427922.739257:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427922.739454:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100224 00000100:00100000:1.0:1789427922.739462:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100224 00000100:00100000:1.0:1789427922.739520:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789427922.739530:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940100224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789427922.739563:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789427922.739616:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940100224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.739623:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789427922.739703:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940100224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427922.918888:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.918940:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.918980:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.919016:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.919049:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676416 00000100:00100000:2.0:1789427922.919060:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676416 00000100:00100000:2.0:1789427922.919116:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676032 00000100:00100000:2.0:1789427922.919120:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676032 00000100:00100000:2.0:1789427922.919140:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 314 00000100:00100000:2.0:1789427922.919149:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931676416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427922.919215:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931676416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.919239:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 314 00000100:00100000:2.0:1789427922.919255:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 315 00000100:00100000:2.0:1789427922.919262:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931676032:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427922.919285:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931676032:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.919290:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 315 00000100:00100000:2.0:1789427922.919323:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427922.919467:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676288 00000100:00100000:2.0:1789427922.919472:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676288 00000100:00100000:2.0:1789427922.919500:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 316 00000100:00100000:2.0:1789427922.919506:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931676288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427922.919536:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931676288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.919541:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 316 00000100:00100000:1.0:1789427922.919826:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931675904 00000100:00100000:1.0:1789427922.919831:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931675904 00000100:00100000:1.0:1789427922.919875:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 384 00000100:00100000:1.0:1789427922.919882:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931675904:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427922.919913:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931675904:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427922.919920:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 384 00000100:00080000:1.0:1789427922.919946:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789427922.919950:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427922.920848:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676160 00000100:00100000:0.0:1789427922.920855:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676160 00000100:00100000:0.0:1789427922.920919:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:0.0:1789427922.920927:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931676160:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427922.920994:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931676160:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 68us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.921002:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00080000:1.0:1789427922.923309:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427923.251520:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940100352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427923.251608:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.251819:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100352 00000100:00100000:3.0:1789427923.251827:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100352 00000100:00100000:3.0:1789427923.252030:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789427923.252041:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940100352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427923.252070:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427923.252118:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940100352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.252125:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789427923.252389:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427923.252458:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940100352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427923.254960:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940100480:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255025:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427923.255074:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100480 00000100:00100000:1.0:1789427923.255081:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100480 00000100:00100000:1.0:1789427923.255118:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789427923.255127:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255175:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940100480:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427923.255182:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789427923.255223:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940100480:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255270:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427923.255275:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940100864:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255298:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427923.255333:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940100992:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255352:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427923.255392:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427923.255397:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940101376:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255763:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427923.255791:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101376 00000100:00100000:1.0:1789427923.255796:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101376 00000100:00100000:1.0:1789427923.255826:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427923.255833:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940101376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.255868:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940101376:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427923.255875:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427923.256266:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940101376:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.256302:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940101504:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.256325:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.256904:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940100608:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.256944:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.256961:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940101120:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.256981:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.257001:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940101632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257018:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.257028:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789427923.257032:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940100736:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257050:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.257065:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940101248:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257083:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.257096:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940101760:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257114:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.257140:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100864 00000100:00100000:3.0:1789427923.257144:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100864 00000100:00100000:3.0:1789427923.257169:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100992 00000100:00100000:3.0:1789427923.257172:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100992 00000100:00100000:3.0:1789427923.257211:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101504 00000100:00100000:3.0:1789427923.257214:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101504 00000100:00100000:3.0:1789427923.257229:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100608 00000100:00100000:3.0:1789427923.257231:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100608 00000100:00100000:3.0:1789427923.257242:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101120 00000100:00100000:3.0:1789427923.257245:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101120 00000100:00100000:3.0:1789427923.257257:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101632 00000100:00100000:3.0:1789427923.257260:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101632 00000100:00100000:3.0:1789427923.257274:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789427923.257281:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940100864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257319:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940100864:12345-0@lo:400:kworker.0 Request processed in 38us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.257335:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789427923.257351:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789427923.257356:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257385:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940100992:12345-0@lo:400:kworker.0 Request processed in 29us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.257391:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789427923.257402:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789427923.257408:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940101504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257665:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940101504:12345-0@lo:400:kworker.0 Request processed in 257us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.257672:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789427923.257685:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789427923.257690:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.257720:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940100608:12345-0@lo:400:kworker.0 Request processed in 30us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.258262:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789427923.258277:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789427923.258284:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940101120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.258316:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940101120:12345-0@lo:400:kworker.0 Request processed in 33us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.258322:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789427923.258332:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789427923.258338:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940101632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.258362:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940101632:12345-0@lo:400:kworker.0 Request processed in 25us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.258375:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789427923.258397:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940100736 00000100:00100000:3.0:1789427923.258402:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940100736 00000100:00100000:3.0:1789427923.258651:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789427923.258659:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.258691:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940100736:12345-0@lo:400:kworker.0 Request processed in 34us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.258697:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789427923.258716:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101248 00000100:00100000:3.0:1789427923.258720:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101248 00000100:00100000:3.0:1789427923.258810:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101760 00000100:00100000:3.0:1789427923.258815:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101760 00000100:00100000:3.0:1789427923.258832:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789427923.258838:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940101248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.258971:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940101248:12345-0@lo:400:kworker.0 Request processed in 132us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.258978:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789427923.258990:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789427923.258996:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940101760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.259023:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940101760:12345-0@lo:400:kworker.0 Request processed in 27us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.259028:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789427923.259074:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940100736:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.259086:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940101248:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.259094:0:3613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789427923.259105:0:3613:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:3.0:1789427923.259133:0:3613:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9195847b9c00, transno 4294967308 00000004:00080000:3.0:1789427923.259144:0:3613:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:3.0:1789427923.259166:0:3613:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff919584560e00 x1876350940098944/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789427938 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427923.259176:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940101760:0@lo:400:kworker.0 00000100:00100000:3.0:1789427923.259190:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940100608:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.259334:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940101504:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.259344:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940100992:0@lo:400:kworker.0 00000100:00100000:1.0:1789427923.259362:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940100864:0@lo:400:kworker.0 00010000:00080000:3.0:1789427923.261575:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958453c000 x1876350940101120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427923.261651:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940101120:0@lo:400:kworker.0 00010000:00080000:3.0:1789427923.261675:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958453d180 x1876350940101632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427923.261682:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940101632:0@lo:400:kworker.0 00000100:00080000:2.0:1789427923.263121:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427923.263130:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427923.263133:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427923.263214:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427923.263227:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940101888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427923.263289:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427923.263349:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940101888 00000100:00100000:2.0:1789427923.263356:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940101888 00000100:00100000:2.0:1789427923.263398:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789427923.263407:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940101888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427923.263465:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427923.263506:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940101888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.263513:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789427923.263551:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940101888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427923.389474:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427923.447978:0:14720:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427923.447987:0:14720:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427923.448034:0:14720:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789427923.448040:0:14720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789427923.507552:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427923.507560:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427923.507582:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789427923.507589:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427923.507735:0:13758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940102016:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427923.507832:0:13758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427923.526034:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427923.526074:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676544 00000100:00100000:3.0:1789427923.526084:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676544 00000100:00100000:3.0:1789427923.526139:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 249 00000100:00100000:3.0:1789427923.526149:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+28:12455:x1876350931676544:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789427923.526184:0:6482:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789427923.528094:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f916dfa-5c35-44f7-8247-070d65680205+28:12455:x1876350931676544:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 1941us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.528105:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 249 00000100:00100000:3.0:1789427923.528170:0:13758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13758:1876350940102016:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427923.534197:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427923.534554:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931676800 00000100:00100000:1.0:1789427923.534564:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931676800 00000100:00100000:1.0:1789427923.534615:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 250 00000100:00100000:1.0:1789427923.534625:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+27:12455:x1876350931676800:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427923.534646:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427923.534667:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede519377 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ed3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.534780:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51937e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.534795:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51937e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.534807:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51937e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427923.534818:0:6483:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789427923.534931:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede519377 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ed3 expref: 30 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.534949:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51937e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ed3 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.534958:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427923.534961:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427923.534970:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46e00, rc 0) 00000100:00100000:1.0:1789427923.535018:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:12455:x1876350931676800:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 396us (832us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789427923.535026:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 250 00000100:00100000:3.0:1789427923.545862:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427923.545916:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427923.546036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677184 00000100:00100000:1.0:1789427923.546046:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677184 00000100:00100000:1.0:1789427923.546116:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1789427923.546126:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+29:2397:x1876350931677184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427923.546142:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427923.546166:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede51937e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ed3 expref: 29 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.546185:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427923.546189:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427923.546251:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f916dfa-5c35-44f7-8247-070d65680205+28:2397:x1876350931677184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427923.546258:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789427923.546702:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677056 00000100:00100000:0.0:1789427923.546708:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677056 00000100:00100000:0.0:1789427923.546756:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 251 00000100:00100000:0.0:1789427923.546764:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+28:12455:x1876350931677056:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789427923.546837:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.546853:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.546864:0:8108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547035:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547044:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547050:0:8108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547056:0:8108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427923.547060:0:8108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547066:0:8108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547087:0:8108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427923.547089:0:8108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427923.547093:0:8108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.547099:0:8108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede51938c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.547177:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+29:12455:x1876350931677056:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 414us (1325us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789427923.547184:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 251 00000040:00080000:0.0:1789427923.547284:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427923.547288:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427923.547806:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789427923.547816:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427923.561189:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427923.561601:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677440 00000100:00100000:2.0:1789427923.561612:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677440 00000100:00100000:2.0:1789427923.561751:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:2.0:1789427923.561763:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+29:12455:x1876350931677440:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789427923.562009:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+30:12455:x1876350931677440:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 249us (829us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789427923.562016:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1789427924.273177:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427924.273266:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427924.273490:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102144 00000100:00100000:3.0:1789427924.273499:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102144 00000100:00100000:3.0:1789427924.273569:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789427924.273581:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940102144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427924.273609:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789427924.273657:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940102144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427924.273664:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789427924.273739:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427924.273790:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427924.274397:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427924.285214:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940102272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427924.285309:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427924.302126:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102272 00000100:00100000:2.0:1789427924.302146:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102272 00000100:00100000:2.0:1789427924.302249:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789427924.302262:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940102272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427924.302297:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789427924.302407:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940102272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (17097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427924.302448:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789427924.303736:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940102272:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427924.400750:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427925.433847:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427925.492390:0:14771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427925.492401:0:14771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427925.492456:0:14771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789427925.492465:0:14771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427925.758105:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427925.758187:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677696 00000100:00100000:1.0:1789427925.758210:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677696 00000100:00100000:1.0:1789427925.758290:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 252 00000100:00100000:1.0:1789427925.758301:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+30:12476:x1876350931677696:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789427925.758325:0:10064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427925.758356:0:10064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede519393 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300eda expref: -99 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427925.758504:0:10064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede51939a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427925.758521:0:10064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede51939a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427925.758534:0:10064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede51939a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427925.758544:0:10064:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789427925.758642:0:10064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede519393 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eda expref: 33 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427925.758659:0:10064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede51939a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eda expref: 32 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427925.758667:0:10064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:1.0:1789427925.758669:0:10064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789427925.758673:0:10064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47600, rc 0) 00000100:00100000:1.0:1789427925.758730:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+32:12476:x1876350931677696:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 432us (637us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789427925.758736:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 252 00000100:00080000:0.0:1789427925.758802:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427925.763335:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427925.763479:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677824 00000100:00100000:0.0:1789427925.763489:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677824 00000100:00100000:0.0:1789427925.763549:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 253 00000100:00100000:0.0:1789427925.763560:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+32:12476:x1876350931677824:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:0.0:1789427925.763629:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763669:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763681:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763727:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763735:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763742:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763749:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789427925.763753:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763769:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763780:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:0.0:1789427925.763783:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427925.763787:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.763793:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e800/0x84fc867ede5193a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427925.763856:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+32:12476:x1876350931677824:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 299us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427925.763871:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 253 00000100:00100000:2.0:1789427925.809451:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940102400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789427925.809521:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427925.809637:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102400 00000100:00100000:0.0:1789427925.809646:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102400 00000100:00100000:0.0:1789427925.809711:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789427925.809721:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940102400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427925.809755:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789427925.809812:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940102400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427925.809819:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789427925.809900:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940102400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427925.908374:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427925.909078:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931677952 00000100:00100000:0.0:1789427925.909089:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931677952 00000100:00080000:2.0:1789427925.909170:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427925.909176:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:0.0:1789427925.909460:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2394:x1876350931677952:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1789427925.909477:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427925.909496:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5193af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ee1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789427925.909520:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa880d0, atime: 0x6aa880d0, ctime: 0x6aa880d0, blocks: 0x8 00010000:00010000:0.0:1789427925.909540:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=270s v=(0 0) 00010000:00010000:0.0:1789427925.909544:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427925.909552:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5193af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee1 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.909569:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5193af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee1 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.909601:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e800, rc 0) 00000100:00100000:0.0:1789427925.909712:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+8:2394:x1876350931677952:12345-192.168.202.24@tcp:101:cat.0 Request processed in 528us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427925.909720:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:3.0:1789427925.913069:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427925.913288:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678080 00000100:00100000:2.0:1789427925.913298:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678080 00002000:00100000:2.0:1789427925.913352:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9196bfae1880 x1876350931678080/t0(0) o3->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:171/0 lens 488/0 e 0 to 0 dl 1789427936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427925.913363:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae1880 with x1876350931678080 ext(0->4095) 00002000:00010000:2.0:1789427925.913370:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfae1880 00000100:00100000:2.0:1789427925.913477:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789427925.913488:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931678080:12345-192.168.202.24@tcp:3:cat.0 00000100:00100000:2.0:1789427925.913680:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2397:x1876350931678080:12345-192.168.202.24@tcp:3:cat.0 Request processed in 194us (616us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789427925.913688:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00002000:00100000:2.0:1789427925.913695:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9196bfae1880 x1876350931678080/t0(0) o3->2f916dfa-5c35-44f7-8247-070d65680205@192.168.202.24@tcp:171/0 lens 488/4536 e 0 to 0 dl 1789427936 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427925.913719:0:8405:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9196bfae1880 with x1876350931678080 ext(0->4095) 00002000:00010000:2.0:1789427925.913744:0:8405:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9196bfae1880 00010000:00010000:0.0:1789427926.449108:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427927.477035:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427927.861446:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427927.861468:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427927.861540:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427927.861614:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102528 00000100:00100000:2.0:1789427927.861622:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102528 00000100:00100000:2.0:1789427927.861669:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789427927.861678:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940102528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427927.861730:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427927.861778:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940102528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.861786:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789427927.861832:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427928.045074:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045113:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045155:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045189:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045212:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045230:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045252:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427928.045284:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678336 00000100:00100000:3.0:1789427928.045293:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678336 00000100:00100000:3.0:1789427928.045352:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678848 00000100:00100000:3.0:1789427928.045356:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678848 00000100:00100000:3.0:1789427928.045372:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678464 00000100:00100000:3.0:1789427928.045388:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678464 00000100:00100000:3.0:1789427928.045403:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678976 00000100:00100000:3.0:1789427928.045405:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678976 00000100:00100000:3.0:1789427928.045459:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 323 00000100:00100000:3.0:1789427928.045470:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+32:2396:x1876350931678336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427928.045552:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+32:2396:x1876350931678336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427928.045559:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 323 00000100:00100000:3.0:1789427928.045577:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 324 00000100:00100000:3.0:1789427928.045583:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931678848:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427928.045605:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931678848:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427928.045611:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 324 00000100:00100000:3.0:1789427928.045622:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 325 00000100:00100000:3.0:1789427928.045627:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931678464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427928.045647:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931678464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 20us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427928.045653:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 325 00000100:00100000:3.0:1789427928.045663:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 326 00000100:00100000:3.0:1789427928.045669:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931678976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427928.045703:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931678976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427928.045709:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 326 00000100:00100000:3.0:1789427928.045727:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678208 00000100:00100000:3.0:1789427928.045742:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678208 00000100:00100000:3.0:1789427928.045768:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 386 00000100:00100000:3.0:1789427928.045775:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931678208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427928.045800:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931678208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427928.045807:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 386 00000100:00080000:3.0:1789427928.045833:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427928.045837:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427928.046039:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678592 00000100:00100000:1.0:1789427928.046044:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678592 00000100:00100000:1.0:1789427928.046078:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931678720 00000100:00100000:1.0:1789427928.046081:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931678720 00000100:00100000:1.0:1789427928.046103:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1789427928.046110:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931678592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427928.046143:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+8:2396:x1876350931678592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 34us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.046149:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1789427928.046164:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:1.0:1789427928.046170:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931678720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427928.046194:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931678720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.046200:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00080000:3.0:1789427928.048388:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427928.048398:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427928.373975:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427928.374052:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.374124:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940102784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427928.374167:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.374201:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102656 00000100:00100000:2.0:1789427928.374210:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102656 00000100:00100000:2.0:1789427928.374262:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102784 00000100:00100000:2.0:1789427928.374265:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102784 00000100:00100000:2.0:1789427928.374281:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789427928.374288:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940102656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427928.374316:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427928.374357:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940102656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.374374:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789427928.374391:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789427928.374397:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940102784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789427928.374408:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789427928.374457:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940102784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.374463:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789427928.374481:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427928.374517:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940102784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427928.376347:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940102912:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.376407:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.376458:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940103424:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.376485:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.376504:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940103936:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.376521:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.376541:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789427928.376547:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940103296:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.376566:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.376581:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940103808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.378097:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940102912 00000100:00100000:1.0:1789427928.378109:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940102912 00000100:00100000:1.0:1789427928.378179:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789427928.378190:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940102912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.378269:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940102912:12345-0@lo:400:kworker.0 Request processed in 82us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.378276:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789427928.378316:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103424 00000100:00100000:1.0:1789427928.378320:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103424 00000100:00100000:1.0:1789427928.378356:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103936 00000100:00100000:1.0:1789427928.378359:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103936 00000100:00100000:1.0:1789427928.378374:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103296 00000100:00100000:1.0:1789427928.378387:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103296 00000100:00100000:1.0:1789427928.378404:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789427928.378411:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940103424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.378461:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940103424:12345-0@lo:400:kworker.0 Request processed in 51us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.378467:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789427928.378479:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789427928.378486:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940103936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.378514:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940103936:12345-0@lo:400:kworker.0 Request processed in 29us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.378521:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789427928.378531:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789427928.378536:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.378562:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940103296:12345-0@lo:400:kworker.0 Request processed in 26us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.378567:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000001:00080000:3.0:1789427928.379077:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00080000:1.0:1789427928.379322:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427928.379859:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427928.380783:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940102912:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.380805:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940103424:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.380819:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940103936:0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.381279:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940103296:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.386882:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940103168:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.386959:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427928.387001:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940103680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.387026:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427928.387083:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940102656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427928.387104:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789427928.387110:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940103040:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.387133:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427928.387148:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940103552:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.387166:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427928.387180:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940104064:0@lo:400:kworker.0 00000100:00100000:3.0:1789427928.387197:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427928.387507:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103808 00000100:00100000:1.0:1789427928.387516:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103808 00000100:00100000:1.0:1789427928.387573:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103680 00000100:00100000:1.0:1789427928.387577:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103680 00000100:00100000:1.0:1789427928.388724:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789427928.388915:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789427928.388978:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1789427928.388987:0:8395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:1.0:1789427928.389139:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940103808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.389258:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940103808:12345-0@lo:400:kworker.0 Request processed in 523us (9401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.389267:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789427928.389301:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789427928.389319:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940103680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.389362:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940103680:12345-0@lo:400:kworker.0 Request processed in 45us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427928.389369:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427928.389767:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103168 00000100:00100000:2.0:1789427928.389778:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103168 00000100:00100000:2.0:1789427928.389821:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789427928.389829:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940103168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.390011:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940103168:12345-0@lo:400:kworker.0 Request processed in 182us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.390018:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789427928.390538:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103040 00000100:00100000:2.0:1789427928.390545:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103040 00000100:00100000:3.0:1789427928.390860:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000100:00100000:2.0:1789427928.390969:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940103552 00000100:00100000:2.0:1789427928.390974:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940103552 00000100:00100000:2.0:1789427928.391004:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104064 00000100:00100000:2.0:1789427928.391008:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104064 00000100:00100000:2.0:1789427928.391026:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789427928.391032:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.391084:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940103040:12345-0@lo:400:kworker.0 Request processed in 51us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.391090:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789427928.391105:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789427928.391110:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.391137:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940103552:12345-0@lo:400:kworker.0 Request processed in 27us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.391143:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789427928.391154:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789427928.391160:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427928.391202:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940104064:12345-0@lo:400:kworker.0 Request processed in 42us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427928.391208:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:2.0:1789427928.391386:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789427928.391700:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789427928.391727:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940103808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.410131:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940103040:0@lo:400:kworker.0 00010000:00080000:1.0:1789427928.410163:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361d180 x1876350940103552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427928.410174:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940103552:0@lo:400:kworker.0 00010000:00080000:1.0:1789427928.410187:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958361c380 x1876350940104064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427928.410195:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940104064:0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.410208:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940103168:0@lo:400:kworker.0 00000100:00100000:1.0:1789427928.410218:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940103680:0@lo:400:kworker.0 00000001:00080000:2.0:1789427928.410943:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789427928.410977:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91968570db40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789427928.410982:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bcb85c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91968570d540 00000020:00080000:2.0:1789427928.410985:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196bcb85700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91968549ae00 00000020:00080000:2.0:1789427928.411011:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1789427928.411124:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411136:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411153:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411159:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789427928.411164:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411172:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411189:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9196a235fa00) 00010000:00010000:3.0:1789427928.411192:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427928.411196:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427928.411202:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede51932a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789427928.411802:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789427928.412806:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789427928.496714:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427929.393347:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427929.393372:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940104192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427929.393464:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427929.393534:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104192 00000100:00100000:2.0:1789427929.393543:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104192 00000100:00100000:2.0:1789427929.393588:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789427929.394199:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940104192:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427929.397318:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427929.397341:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940104320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427929.397410:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427929.397489:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104320 00000100:00100000:2.0:1789427929.397498:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104320 00002000:00000024:1.0:1789427929.402815:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789427929.403156:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940104192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9544us (9677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427929.403167:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789427929.403204:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789427929.403217:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940104320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427929.403233:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789427929.403270:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940104320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427929.403289:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789427929.403377:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940104192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427929.403453:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940104320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427929.528536:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427930.547458:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427930.929099:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427930.929123:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940104448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789427930.929198:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427930.929392:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104448 00000100:00100000:0.0:1789427930.929403:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104448 00000100:00100000:0.0:1789427930.929483:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789427930.929492:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940104448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427930.929524:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789427930.929591:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940104448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427930.929599:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789427930.929807:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940104448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427931.568758:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427932.593802:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427932.594377:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789427932.788243:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427932.788252:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427932.788338:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789427932.788346:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427932.976795:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940104576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789427932.976872:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427932.977216:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104576 00000100:00100000:2.0:1789427932.977226:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104576 00000100:00100000:2.0:1789427932.977286:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789427932.977295:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940104576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427932.977346:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427932.977408:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940104576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427932.977439:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789427932.977574:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940104576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427933.170466:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427933.170533:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427933.170562:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427933.170702:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679104 00000100:00100000:1.0:1789427933.170716:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679104 00000100:00100000:1.0:1789427933.170788:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 388 00000100:00100000:1.0:1789427933.170799:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931679104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427933.170899:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931679104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427933.170907:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 388 00000100:00100000:3.0:1789427933.171354:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427933.171389:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427933.171460:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679616 00000100:00100000:1.0:1789427933.171466:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679616 00000100:00100000:1.0:1789427933.171513:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00100000:1.0:1789427933.171521:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931679616:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427933.171563:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931679616:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427933.171570:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00080000:1.0:1789427933.171631:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427933.173544:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427933.174596:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427933.174787:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679232 00000100:00100000:0.0:1789427933.174802:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679232 00000100:00100000:0.0:1789427933.174889:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679360 00000100:00100000:0.0:1789427933.174893:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679360 00000100:00100000:0.0:1789427933.174915:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679872 00000100:00100000:0.0:1789427933.174918:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679872 00000100:00100000:0.0:1789427933.174939:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 333 00000100:00100000:0.0:1789427933.174969:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+18:2395:x1876350931679232:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427933.175069:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+18:2395:x1876350931679232:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 102us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.175076:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 333 00000100:00100000:0.0:1789427933.175098:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 334 00000100:00100000:0.0:1789427933.175105:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931679360:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427933.175129:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2394:x1876350931679360:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.175134:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 334 00000100:00100000:0.0:1789427933.175146:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 335 00000100:00100000:0.0:1789427933.175152:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931679872:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427933.175173:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931679872:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.175178:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 335 00000100:00080000:0.0:1789427933.175203:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789427933.175206:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427933.175341:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679488 00000100:00100000:0.0:1789427933.175346:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679488 00000100:00100000:0.0:1789427933.175378:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 153 00000100:00100000:0.0:1789427933.175385:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2395:x1876350931679488:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427933.175438:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f916dfa-5c35-44f7-8247-070d65680205+7:2395:x1876350931679488:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 53us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.175443:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 153 00000100:00080000:0.0:1789427933.175477:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427933.176631:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931679744 00000100:00100000:1.0:1789427933.176651:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931679744 00000100:00100000:0.0:1789427933.176779:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 336 00000100:00100000:0.0:1789427933.176789:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931679744:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789427933.176864:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2395:x1876350931679744:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 77us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.176871:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 336 00000100:00080000:2.0:1789427933.177951:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427933.210874:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427933.211001:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680000 00000100:00100000:2.0:1789427933.211011:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680000 00000100:00100000:2.0:1789427933.211079:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 254 00000100:00100000:2.0:1789427933.211089:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+18:12129:x1876350931680000:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789427933.211220:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+18:12129:x1876350931680000:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.211228:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 254 00000100:00100000:3.0:1789427933.219534:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427933.219800:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680128 00000100:00100000:0.0:1789427933.219812:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680128 00000100:00100000:0.0:1789427933.219876:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 255 00000100:00100000:0.0:1789427933.219887:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:12129:x1876350931680128:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789427933.220017:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:12129:x1876350931680128:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 130us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.220024:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 255 00000100:00100000:3.0:1789427933.222954:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427933.223059:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680384 00000100:00100000:2.0:1789427933.223072:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680384 00000100:00100000:2.0:1789427933.223133:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1789427933.223142:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+18:12129:x1876350931680384:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789427933.223364:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+19:12129:x1876350931680384:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 223us (421us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789427933.223372:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:3.0:1789427933.490745:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940104704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427933.490825:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427933.491318:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104704 00000100:00100000:1.0:1789427933.491335:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104704 00000100:00100000:1.0:1789427933.491391:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789427933.491402:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940104704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427933.491454:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427933.491503:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940104704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427933.491510:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789427933.491678:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940104960:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491714:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.491750:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940105472:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491773:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.491791:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940105984:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491830:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.491867:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789427933.491874:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940104832:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491902:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.491923:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940105344:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491944:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.491958:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940105856:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.491977:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427933.492004:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104832 00000100:00100000:2.0:1789427933.492009:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104832 00000100:00100000:2.0:1789427933.492039:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789427933.492046:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940104832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492081:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940104832:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492087:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789427933.492128:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940104832:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492152:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940104960 00000100:00100000:2.0:1789427933.492156:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940104960 00000100:00100000:2.0:1789427933.492175:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105472 00000100:00100000:2.0:1789427933.492178:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105472 00000100:00100000:2.0:1789427933.492192:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105984 00000100:00100000:2.0:1789427933.492195:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105984 00000100:00100000:2.0:1789427933.492207:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105344 00000100:00100000:2.0:1789427933.492209:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105344 00000100:00100000:2.0:1789427933.492223:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105856 00000100:00100000:2.0:1789427933.492225:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105856 00000100:00100000:2.0:1789427933.492238:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789427933.492244:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940104960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492287:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940104960:12345-0@lo:400:kworker.0 Request processed in 43us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492294:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789427933.492307:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789427933.492312:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940105472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492353:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940105472:12345-0@lo:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492358:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789427933.492370:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789427933.492375:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940105984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492398:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940105984:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492403:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789427933.492436:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789427933.492443:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940105344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492468:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940105344:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492474:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789427933.492486:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789427933.492492:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940105856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492515:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940105856:12345-0@lo:400:kworker.0 Request processed in 23us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.492519:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789427933.492543:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940105344:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492561:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940105856:0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.492569:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940104960:0@lo:400:kworker.0 00010000:00080000:2.0:1789427933.492580:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958453c000 x1876350940105472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427933.492590:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940105472:0@lo:400:kworker.0 00010000:00080000:2.0:1789427933.492598:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958453ca80 x1876350940105984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427933.492606:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940105984:0@lo:400:kworker.0 00000100:00080000:2.0:1789427933.492641:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427933.492645:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427933.492648:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427933.492968:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940105088:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493007:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493042:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940105600:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493065:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493085:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106112:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493105:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493125:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789427933.493132:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940105216:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493152:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493168:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940105728:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493188:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493216:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427933.493240:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427933.493268:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105600 00000100:00100000:0.0:1789427933.493273:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105600 00000100:00100000:0.0:1789427933.493311:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106112 00000100:00100000:0.0:1789427933.493314:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106112 00000100:00100000:0.0:1789427933.493350:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105728 00000100:00100000:0.0:1789427933.493353:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105728 00000100:00100000:0.0:1789427933.493368:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789427933.493376:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493459:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940105600:12345-0@lo:400:kworker.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.493466:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789427933.493480:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789427933.493486:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493515:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106112:12345-0@lo:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.493521:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789427933.493533:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789427933.493538:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940105728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493561:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940105728:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.493565:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789427933.493580:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106240 00000100:00100000:0.0:1789427933.493584:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106240 00000100:00100000:0.0:1789427933.493603:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789427933.493608:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427933.493629:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427933.493677:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.493682:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789427933.493726:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105216 00000100:00100000:0.0:1789427933.493729:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105216 00000100:00100000:0.0:1789427933.493749:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789427933.493755:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.493781:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940105216:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427933.493786:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:0.0:1789427933.493800:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427933.493803:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427933.493833:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940105216:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.494118:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940105728:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.494127:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789427933.494133:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919584560e00, transno 4294967311 00000100:00100000:0.0:1789427933.494148:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427933.494159:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940105600:0@lo:400:kworker.0 00000100:00100000:0.0:1789427933.494166:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106112:0@lo:400:kworker.0 00000100:00100000:3.0:1789427933.494303:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940104704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427933.499001:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940105088 00000100:00100000:2.0:1789427933.499017:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940105088 00000100:00100000:2.0:1789427933.499081:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789427933.499091:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940105088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427933.499209:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940105088:12345-0@lo:400:kworker.0 Request processed in 119us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427933.499216:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789427933.499388:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940105088:0@lo:400:kworker.0 00000001:00080000:2.0:1789427933.503151:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789427933.503166:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789427933.503318:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789427933.503341:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789427933.616787:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427934.513811:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940106368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427934.513889:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427934.513968:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427934.513975:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940106496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427934.513998:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427934.514104:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106368 00000100:00100000:2.0:1789427934.514112:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106368 00000100:00100000:2.0:1789427934.514164:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106496 00000100:00100000:2.0:1789427934.514168:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106496 00000100:00100000:2.0:1789427934.514184:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427934.514193:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940106368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789427934.514238:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789427934.514297:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940106368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427934.514305:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427934.514320:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789427934.514326:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940106496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427934.514337:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789427934.514358:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940106496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427934.514363:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789427934.514502:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940106496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427934.514514:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940106368:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427934.640699:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427935.664665:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427935.696201:0:14968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:18:53 (1789427933) 00000100:00100000:0.0:1789427936.050824:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427936.050846:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940106624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427936.050917:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427936.050979:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106624 00000100:00100000:0.0:1789427936.051001:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106624 00000100:00100000:0.0:1789427936.051048:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789427936.051058:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940106624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427936.051090:0:7439:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789427936.051133:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940106624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427936.051140:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789427936.051178:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940106624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789427936.692010:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427937.714770:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427938.106348:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427938.106371:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427938.106458:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.106526:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106752 00000100:00100000:3.0:1789427938.106548:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106752 00000100:00100000:3.0:1789427938.106605:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789427938.106615:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789427938.106650:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789427938.106695:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940106752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.106702:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789427938.106745:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940106752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789427938.283131:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427938.283192:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427938.283197:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680512 00000100:00100000:0.0:1789427938.283208:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680512 00000100:00100000:2.0:1789427938.283224:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427938.283250:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427938.283263:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 390 00000100:00100000:0.0:1789427938.283278:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931680512:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427938.283280:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427938.283307:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427938.283335:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427938.283356:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2396:x1876350931680512:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427938.283364:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 390 00000100:00100000:1.0:1789427938.293543:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681024 00000100:00100000:1.0:1789427938.293561:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681024 00000100:00100000:1.0:1789427938.293644:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680896 00000100:00100000:1.0:1789427938.293650:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680896 00000100:00100000:1.0:1789427938.293681:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:1.0:1789427938.293694:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931681024:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427938.293783:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931681024:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (10558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.293790:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:1.0:1789427938.293811:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:1.0:1789427938.293818:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931680896:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427938.293844:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2f916dfa-5c35-44f7-8247-070d65680205+7:2396:x1876350931680896:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (10537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.293850:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00080000:0.0:1789427938.293887:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427938.293888:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680768 00000100:00080000:0.0:1789427938.293894:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427938.293896:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680768 00000100:00100000:1.0:1789427938.293945:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681280 00000100:00100000:1.0:1789427938.293949:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681280 00000100:00100000:1.0:1789427938.293962:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931680640 00000100:00100000:1.0:1789427938.293965:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931680640 00000100:00100000:1.0:1789427938.293977:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681152 00000100:00100000:1.0:1789427938.293980:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681152 00000100:00100000:1.0:1789427938.293993:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 343 00000100:00100000:1.0:1789427938.294000:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931680768:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427938.294030:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2396:x1876350931680768:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (10839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.294036:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 343 00000100:00100000:1.0:1789427938.294049:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 344 00000100:00100000:1.0:1789427938.294055:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931681280:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427938.294077:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931681280:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (10827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.294083:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 344 00000100:00100000:1.0:1789427938.294094:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 345 00000100:00100000:1.0:1789427938.294100:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931680640:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789427938.294128:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f916dfa-5c35-44f7-8247-070d65680205+18:2396:x1876350931680640:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (10853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.294134:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 345 00000100:00100000:1.0:1789427938.294147:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 346 00000100:00100000:1.0:1789427938.294153:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931681152:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:0.0:1789427938.294195:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427938.294199:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427938.295386:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2396:x1876350931681152:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1224us (12041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.295408:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 346 00000100:00100000:1.0:1789427938.608821:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940107264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.608900:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.608958:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940107776:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.608982:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.609004:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940108288:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609023:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.609057:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789427938.609062:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940107136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609085:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.609099:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940107648:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609118:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.609133:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940108160:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609151:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.609382:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107264 00000100:00100000:1.0:1789427938.609390:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107264 00000100:00100000:1.0:1789427938.609452:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107648 00000100:00100000:1.0:1789427938.609456:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107648 00000100:00100000:1.0:1789427938.609479:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108160 00000100:00100000:1.0:1789427938.609482:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108160 00000100:00100000:1.0:1789427938.609498:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789427938.609505:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940107264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609557:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940107264:12345-0@lo:400:kworker.0 Request processed in 52us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.609564:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789427938.609611:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789427938.609618:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609650:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940107648:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.609656:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789427938.609667:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789427938.609673:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940108160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609696:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940108160:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.609702:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:1.0:1789427938.609735:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c95880 x1876350940107648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427938.609749:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940107648:0@lo:400:kworker.0 00010000:00080000:1.0:1789427938.609759:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c96680 x1876350940108160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427938.609767:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940108160:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609776:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940107264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609817:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940106880:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.609842:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107776 00000100:00100000:1.0:1789427938.609846:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.609847:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107776 00000100:00100000:3.0:1789427938.609875:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108288 00000100:00100000:3.0:1789427938.609878:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108288 00000100:00100000:3.0:1789427938.609900:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789427938.609907:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940107776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609935:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940107392:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.609945:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940107776:12345-0@lo:400:kworker.0 Request processed in 40us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.609951:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789427938.609958:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.609964:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789427938.609969:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940108288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609975:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940107904:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.609992:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.609994:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940108288:12345-0@lo:400:kworker.0 Request processed in 26us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.609999:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789427938.610008:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107904 00000100:00100000:3.0:1789427938.610011:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107904 00000100:00100000:1.0:1789427938.610013:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940108416:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610025:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789427938.610031:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940107904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610056:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940107904:12345-0@lo:400:kworker.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.610068:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789427938.610127:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107136 00000100:00100000:0.0:1789427938.610128:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940107008:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610130:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107136 00000100:00100000:3.0:1789427938.610150:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107392 00000100:00100000:3.0:1789427938.610153:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107392 00000100:00100000:0.0:1789427938.610156:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.610164:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789427938.610170:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940107136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427938.610189:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940107520:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610200:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940107136:12345-0@lo:400:kworker.0 Request processed in 31us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.610206:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789427938.610209:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427938.610224:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940108032:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610230:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789427938.610236:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940107392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427938.610243:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427938.610252:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940108544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427938.610258:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940107392:12345-0@lo:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427938.610263:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789427938.610280:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427938.610287:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940107136:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610296:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940107776:0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.610304:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940108288:0@lo:400:kworker.0 00000100:00100000:0.0:1789427938.610315:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107008 00000100:00100000:0.0:1789427938.610318:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107008 00000100:00080000:3.0:1789427938.610328:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427938.610332:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427938.610335:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789427938.610336:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940107520 00000100:00100000:0.0:1789427938.610338:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940107520 00000100:00100000:3.0:1789427938.610342:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108032 00000100:00100000:3.0:1789427938.610344:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108032 00000100:00100000:0.0:1789427938.610356:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789427938.610361:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940107008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427938.610537:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940107008:12345-0@lo:400:kworker.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.610754:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.610781:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940107392:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.610790:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940107904:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.610809:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108416 00000100:00100000:1.0:1789427938.610812:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108416 00000100:00100000:1.0:1789427938.610838:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789427938.610844:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940108416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.610890:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940108416:12345-0@lo:400:kworker.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.610896:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789427938.610917:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940108416:0@lo:400:kworker.0 00000100:00080000:1.0:1789427938.610935:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427938.610938:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427938.610956:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940107008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.610987:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108544 00000100:00100000:1.0:1789427938.610990:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108544 00000100:00100000:1.0:1789427938.611013:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789427938.611019:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940108544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427938.611052:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427938.611086:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940108544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.611091:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789427938.611114:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940106880 00000100:00100000:1.0:1789427938.611117:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940106880 00000100:00100000:1.0:1789427938.611140:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789427938.611156:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940106880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427938.611485:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789427938.611495:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940107520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.611504:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940106880:12345-0@lo:400:kworker.0 Request processed in 350us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.611510:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789427938.611532:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940107520:12345-0@lo:400:kworker.0 Request processed in 40us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.611537:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789427938.611650:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940108032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.611683:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940108032:12345-0@lo:400:kworker.0 Request processed in 140us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.611690:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789427938.611727:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940107520:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.611738:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940108032:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.611753:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940108544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427938.611778:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940106880:0@lo:400:kworker.0 00000100:00100000:1.0:1789427938.611819:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427938.611827:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940108672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427938.611853:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427938.611886:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108672 00000100:00100000:1.0:1789427938.611890:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108672 00000100:00100000:1.0:1789427938.611913:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427938.611920:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940108672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427938.611930:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427938.611959:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940108672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.611965:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427938.612001:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940108672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427938.619934:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789427938.621467:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:2.0:1789427938.738990:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427938.770158:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427938.770351:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681408 00000100:00100000:1.0:1789427938.770361:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681408 00000100:00100000:1.0:1789427938.770463:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 256 00000100:00100000:1.0:1789427938.770474:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:13149:x1876350931681408:12345-192.168.202.24@tcp:101:lsof.0 00010000:00010000:1.0:1789427938.770495:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427938.770516:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede5193b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ee8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770595:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770610:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770622:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427938.770822:0:6482:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789427938.770827:0:6482:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789427938.770870:0:6482:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770898:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46e00/0x84fc867ede5193b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee8 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770919:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee8 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427938.770927:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:1.0:1789427938.770943:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427938.770947:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47a00, rc 0) 00000100:00100000:1.0:1789427938.771008:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:13149:x1876350931681408:12345-192.168.202.24@tcp:101:lsof.0 Request processed in 536us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427938.771016:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 256 00000100:00100000:3.0:1789427939.632673:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427939.632696:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940108800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427939.632765:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427939.632877:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108800 00000100:00100000:0.0:1789427939.632885:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108800 00000100:00100000:0.0:1789427939.632940:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789427939.632949:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940108800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427939.632977:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789427939.633034:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940108800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427939.633041:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789427939.633234:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427939.633244:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940108928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427939.633272:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427939.633515:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940108928 00000100:00100000:1.0:1789427939.633520:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940108928 00000100:00100000:1.0:1789427939.633547:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789427939.633554:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940108928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427939.633566:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789427939.633618:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940108928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427939.633624:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789427939.633754:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940108800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789427939.633824:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940108928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427939.761037:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427940.784798:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.172452:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427941.172481:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940109056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789427941.172573:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427941.172907:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109056 00000100:00100000:3.0:1789427941.172917:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109056 00000100:00100000:3.0:1789427941.172968:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789427941.172977:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940109056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789427941.173010:0:6488:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789427941.173064:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940109056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427941.173072:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789427941.173121:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940109056:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789427941.808728:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789427942.000971:0:13758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427942.000980:0:13758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427942.001085:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789427942.001092:0:13758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427942.710156:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.711618:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681664 00000100:00100000:0.0:1789427942.711632:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681664 00000100:00100000:0.0:1789427942.711721:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1789427942.711734:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+18:13150:x1876350931681664:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:0.0:1789427942.712003:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+19:13150:x1876350931681664:12345-192.168.202.24@tcp:35:umount.0 Request processed in 272us (1857us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789427942.712024:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00080000:1.0:1789427942.712264:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427942.718929:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.720368:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931681920 00000100:00100000:0.0:1789427942.720381:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931681920 00000100:00100000:0.0:1789427942.720488:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1789427942.720499:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+19:13150:x1876350931681920:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:0.0:1789427942.723007:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f916dfa-5c35-44f7-8247-070d65680205+20:13150:x1876350931681920:12345-192.168.202.24@tcp:35:umount.0 Request processed in 2501us (4080us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789427942.723020:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1789427942.726722:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427942.726864:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682176 00000100:00100000:2.0:1789427942.726874:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682176 00000100:00100000:2.0:1789427942.726935:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:2.0:1789427942.726945:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91969044dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+20:13150:x1876350931682176:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:2.0:1789427942.727165:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91969044dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:13150:x1876350931682176:12345-192.168.202.24@tcp:35:umount.0 Request processed in 220us (451us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789427942.727173:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:2.0:1789427942.734016:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.736018:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682432 00000100:00100000:0.0:1789427942.736031:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682432 00000100:00100000:0.0:1789427942.736104:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:0.0:1789427942.736116:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:13150:x1876350931682432:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:0.0:1789427942.736402:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:13150:x1876350931682432:12345-192.168.202.24@tcp:35:umount.0 Request processed in 287us (2394us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789427942.736411:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:3.0:1789427942.755121:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427942.755162:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427942.755248:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682688 00000100:00100000:1.0:1789427942.755258:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682688 00000100:00100000:1.0:1789427942.755323:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682560 00000100:00100000:1.0:1789427942.755327:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682560 00000100:00100000:1.0:1789427942.755356:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789427942.755365:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+14:2394:x1876350931682688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427942.755383:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427942.755402:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ed000/0x84fc867ede5182e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a03 expref: 14 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427942.755457:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427942.755512:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+13:2394:x1876350931682688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 147us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427942.755519:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789427942.755540:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1789427942.755557:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+12:2394:x1876350931682560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427942.755565:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427942.755573:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428400/0x84fc867ede518324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a42 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427942.755582:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427942.755600:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2394:x1876350931682560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427942.755605:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1789427942.758665:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.758715:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427942.758782:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682816 00000100:00100000:2.0:1789427942.758792:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682816 00000100:00100000:2.0:1789427942.758867:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:2.0:1789427942.758879:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931682816:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:2.0:1789427942.758921:0:8401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5186c0 00000100:00080000:2.0:1789427942.758933:0:8401:0:(import.c:65:import_set_state_nolock()) ffff919583cae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789427942.758994:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789427942.759156:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f916dfa-5c35-44f7-8247-070d65680205+2:2393:x1876350931682816:12345-192.168.202.24@tcp:9:umount.0 Request processed in 280us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427942.759164:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00010000:00010000:2.0:1789427942.759183:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789427942.759315:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427942.759924:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931682944 00000100:00100000:1.0:1789427942.759931:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931682944 00000100:00100000:1.0:1789427942.759978:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:1.0:1789427942.759986:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+11:2397:x1876350931682944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427942.759998:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427942.760016:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883aa00/0x84fc867ede5185f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b1b expref: 11 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427942.760030:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427942.760066:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2397:x1876350931682944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427942.760088:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789427942.801407:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427942.801611:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931683328 00000100:00100000:1.0:1789427942.801621:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931683328 00000100:00100000:1.0:1789427942.801694:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:1.0:1789427942.801705:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+7:2393:x1876350931683328:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:1.0:1789427942.801737:0:8902:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51892f 00000020:00010000:1.0:1789427942.801745:0:8902:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9196bfad1000: total 0 00000100:00080000:1.0:1789427942.801749:0:8902:0:(import.c:65:import_set_state_nolock()) ffff9196bfad3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427942.801798:0:8902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789427942.801949:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931683328:12345-192.168.202.24@tcp:9:umount.0 Request processed in 245us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427942.801956:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00080000:3.0:1789427942.802124:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1789427942.802568:0:7424:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9196bfad1000: total 0 00010000:00010000:0.0:1789427942.802630:0:7424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9196bfad1000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789427942.802694:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b086ea/0x84fc867ede518cee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d05 expref: 4 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427942.802729:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5193af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee1 expref: 3 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427942.802762:0:7424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9196bfad1000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789427942.802776:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427942.802778:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427942.802780:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427942.827382:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.827521:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684352 00000100:00100000:0.0:1789427942.827530:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684352 00000100:00100000:0.0:1789427942.827622:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 257 00000100:00100000:0.0:1789427942.827632:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+22:2393:x1876350931684352:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:0.0:1789427942.827668:0:6483:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182f3 00000020:00010000:0.0:1789427942.827683:0:6483:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9195837a8000: total 0 00000100:00080000:0.0:1789427942.827689:0:6483:0:(import.c:65:import_set_state_nolock()) ffff9195837aa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789427942.827717:0:6483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789427942.827862:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f916dfa-5c35-44f7-8247-070d65680205+21:2393:x1876350931684352:12345-192.168.202.24@tcp:39:umount.0 Request processed in 231us (489us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789427942.827870:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 257 00000020:00010000:2.0:1789427942.828054:0:9487:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9195837a8000: total 0 00010000:00010000:2.0:1789427942.828123:0:9487:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9195837a8000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789427942.828162:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427942.828180:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427942.828190:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede518caf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cf0 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828212:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427942.828215:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789427942.828219:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede518d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d21 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828234:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427942.828236:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789427942.828240:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47600/0x84fc867ede51939a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300eda expref: 18 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828250:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427942.828253:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789427942.828256:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede518cd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cfe expref: 17 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828266:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff919581d4ee00) 00010000:00010000:2.0:1789427942.828269:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427942.828272:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede519052 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300dfa expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828290:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427942.828293:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427942.828296:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede518991 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300c1e expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828320:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427942.828323:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427942.828327:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519370 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ecc expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828339:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d49300) 00010000:00010000:2.0:1789427942.828341:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427942.828345:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51863b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b30 expref: 13 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828362:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:2.0:1789427942.828364:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427942.828368:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209200/0x84fc867ede518d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300d1a expref: 12 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828379:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff919688862800) 00010000:00010000:2.0:1789427942.828381:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427942.828384:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede518bcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300cb8 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828396:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919581d4e900) 00010000:00010000:2.0:1789427942.828398:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427942.828401:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51861f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b29 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828458:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9196a05efa00) 00010000:00010000:2.0:1789427942.828461:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427942.828483:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede519290 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300e94 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828504:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9196a235f100) 00010000:00010000:2.0:1789427942.828506:0:9487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789427942.828510:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91968883b000/0x84fc867ede518696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b45 expref: 8 pid: 10064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427942.828522:0:9487:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9195837a8000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789427942.828538:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427942.828540:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427942.828542:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427942.835891:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427942.844865:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427942.850534:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427942.850910:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684480 00000100:00100000:0.0:1789427942.850922:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684480 00000100:00100000:0.0:1789427942.851006:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 258 00000100:00100000:0.0:1789427942.851018:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+5:2393:x1876350931684480:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:0.0:1789427942.851061:0:6484:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182fa 00000100:00080000:0.0:1789427942.851084:0:6484:0:(import.c:65:import_set_state_nolock()) ffff9195837e1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789427942.851125:0:6484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789427942.851539:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f916dfa-5c35-44f7-8247-070d65680205+3:2393:x1876350931684480:12345-192.168.202.24@tcp:39:umount.0 Request processed in 523us (1016us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789427942.851557:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 258 00010000:00010000:1.0:1789427942.852369:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789427942.853659:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789427943.217168:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940109184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789427943.217241:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.220486:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109184 00000100:00100000:2.0:1789427943.220503:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109184 00000100:00100000:2.0:1789427943.220586:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789427943.220607:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940109184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789427943.220647:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789427943.220747:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940109184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427943.220755:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789427943.220813:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940109184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789427943.395702:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427943.395758:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427943.395796:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427943.395934:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684608 00000100:00100000:3.0:1789427943.395945:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684608 00000100:00100000:3.0:1789427943.396003:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 392 00000100:00100000:3.0:1789427943.396014:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2394:x1876350931684608:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789427943.396084:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2394:x1876350931684608:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 72us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427943.396092:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 392 00000100:00100000:2.0:1789427943.396575:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684736 00000100:00100000:2.0:1789427943.396581:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684736 00000100:00100000:2.0:1789427943.396639:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684864 00000100:00100000:2.0:1789427943.396643:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684864 00000100:00100000:2.0:1789427943.396665:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 353 00000100:00100000:2.0:1789427943.396673:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2394:x1876350931684736:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427943.396716:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2394:x1876350931684736:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427943.396737:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 353 00000100:00100000:2.0:1789427943.396755:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 354 00000100:00100000:2.0:1789427943.396762:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931684864:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789427943.396787:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2394:x1876350931684864:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427943.396793:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 354 00000100:00080000:3.0:1789427943.396979:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427943.396984:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427943.729006:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940109312:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729077:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729148:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940109824:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729176:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729197:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940110336:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729218:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729233:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940110848:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729252:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729273:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789427943.729279:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940109696:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729302:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729319:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940110208:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729338:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729353:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940110720:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729372:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427943.729410:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110336 00000100:00100000:0.0:1789427943.729445:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110336 00000100:00100000:0.0:1789427943.729493:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110848 00000100:00100000:0.0:1789427943.729497:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110848 00000100:00100000:0.0:1789427943.729509:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110208 00000100:00100000:0.0:1789427943.729512:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110208 00000100:00100000:0.0:1789427943.729523:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110720 00000100:00100000:0.0:1789427943.729525:0:13777:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110720 00000100:00100000:0.0:1789427943.729553:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427943.729562:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940110336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729615:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940110336:12345-0@lo:400:kworker.0 Request processed in 54us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.729639:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427943.729657:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789427943.729663:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940110848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729693:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940110848:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.729698:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789427943.729713:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789427943.729718:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940110208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729741:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940110208:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.729746:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789427943.729757:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789427943.729762:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729785:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940110720:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.729790:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1789427943.729807:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427943.729811:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427943.729820:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109824 00000100:00100000:0.0:1789427943.729824:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109824 00000100:00100000:0.0:1789427943.729847:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789427943.729854:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729887:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940109824:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.729893:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789427943.729934:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940110208:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729945:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940110720:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729952:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940109824:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729960:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940110336:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729968:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940110848:0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.729997:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109696 00000100:00100000:0.0:1789427943.730001:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109696 00000100:00100000:0.0:1789427943.730026:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789427943.730032:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427943.730068:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940109696:12345-0@lo:400:kworker.0 Request processed in 36us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427943.730074:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789427943.730097:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940109696:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730573:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940109440:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730607:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730641:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940109952:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730661:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730684:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940110464:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730705:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730724:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940110976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789427943.730745:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730763:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789427943.730769:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940109568:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730791:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730810:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940110080:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730831:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730848:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940110592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.730868:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730878:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940111104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427943.730897:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427943.730950:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109568 00000100:00100000:2.0:1789427943.730955:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109568 00000100:00100000:2.0:1789427943.730985:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789427943.730993:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940109568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.731031:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940109568:12345-0@lo:400:kworker.0 Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427943.731037:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789427943.731054:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109440 00000100:00100000:2.0:1789427943.731057:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109440 00000100:00100000:2.0:1789427943.731073:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109952 00000100:00100000:2.0:1789427943.731076:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109952 00000100:00100000:2.0:1789427943.731097:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110464 00000100:00100000:2.0:1789427943.731100:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110464 00000100:00100000:2.0:1789427943.731112:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110080 00000100:00100000:2.0:1789427943.731114:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110080 00000100:00100000:2.0:1789427943.731126:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110592 00000100:00100000:2.0:1789427943.731128:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110592 00000100:00100000:1.0:1789427943.731257:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940109312 00000100:00100000:1.0:1789427943.731262:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940109312 00000100:00100000:1.0:1789427943.731294:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789427943.731301:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940109312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.731344:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3616:x1876350940109312:12345-0@lo:400:kworker.0 Request processed in 44us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731350:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789427943.731385:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940110976 00000100:00100000:1.0:1789427943.731409:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940110976 00000100:00100000:1.0:1789427943.731586:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111104 00000100:00100000:1.0:1789427943.731591:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111104 00000100:00100000:1.0:1789427943.731605:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789427943.731610:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940110976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789427943.731631:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427943.731663:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940110976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731670:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789427943.731683:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789427943.731688:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940111104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427943.731698:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789427943.731721:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940111104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731727:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789427943.731767:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940109312:0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.731820:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789427943.731827:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940109440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.731857:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940109440:12345-0@lo:400:kworker.0 Request processed in 31us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731862:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789427943.731878:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789427943.731884:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940109952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.731909:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940109952:12345-0@lo:400:kworker.0 Request processed in 25us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731915:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789427943.731936:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789427943.731942:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940110464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.731970:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940110464:12345-0@lo:400:kworker.0 Request processed in 28us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.731975:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789427943.731987:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789427943.731993:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.732020:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940110080:12345-0@lo:400:kworker.0 Request processed in 27us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427943.732025:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789427943.732068:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940109568:0@lo:400:kworker.0 00010000:00080000:1.0:1789427943.732080:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cbb480 x1876350940110080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427943.732091:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940110080:0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.732108:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940111104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427943.732119:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940109440:0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.732128:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940109952:0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.732282:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789427943.732291:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940110592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427943.732327:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940110592:12345-0@lo:400:kworker.0 Request processed in 38us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427943.732332:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:2.0:1789427943.732349:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789427943.732354:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427943.733652:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940110464:0@lo:400:kworker.0 00000100:00100000:1.0:1789427943.733697:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940110976:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789427943.733751:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c94a80 x1876350940110592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427943.733761:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940110592:0@lo:400:kworker.0 00010000:00010000:0.0:1789427943.859059:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427944.752930:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427944.752953:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940111232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427944.753024:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427944.753266:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111232 00000100:00100000:2.0:1789427944.753274:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111232 00000100:00100000:2.0:1789427944.753331:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789427944.753343:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940111232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427944.753371:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789427944.753447:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940111232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427944.753472:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789427944.753572:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940111232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427944.753842:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427944.753853:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940111360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427944.753889:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427944.754036:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111360 00000100:00100000:0.0:1789427944.754041:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111360 00000100:00100000:0.0:1789427944.754079:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789427944.754087:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940111360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427944.754100:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789427944.754134:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940111360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427944.754140:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789427944.754299:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940111360:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427944.882292:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427945.438076:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427945.438181:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931685248 00000100:00100000:2.0:1789427945.438191:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931685248 00000100:00100000:2.0:1789427945.438265:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:2.0:1789427945.438276:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+10:2395:x1876350931685248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427945.438292:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427945.438320:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699964a00/0x84fc867ede5185ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300b14 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427945.438340:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427945.438400:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2395:x1876350931685248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427945.438408:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:2.0:1789427945.441344:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789427945.441554:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931684992 00000100:00100000:3.0:1789427945.441564:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931684992 00000100:00100000:3.0:1789427945.441643:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789427945.441654:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+9:2396:x1876350931684992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427945.441671:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427945.441691:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208400/0x84fc867ede5183f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a57 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427945.441710:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427945.446480:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:2396:x1876350931684992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4801us (5117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427945.446495:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1789427945.447534:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427945.447672:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789427945.448099:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931685120 00000100:00100000:0.0:1789427945.448133:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931685120 00000100:00100000:0.0:1789427945.448195:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1789427945.448205:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688830450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+8:2396:x1876350931685120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427945.448219:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427945.448239:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208c00/0x84fc867ede5183fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a88 expref: 8 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427945.448256:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427945.448684:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931685504 00000100:00100000:3.0:1789427945.448689:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931685504 00000100:00100000:3.0:1789427945.448752:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 259 00000100:00100000:3.0:1789427945.448760:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+6:2393:x1876350931685504:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:3.0:1789427945.448807:0:6484:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51840b 00000020:00010000:3.0:1789427945.448815:0:6484:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91958343a800: total 0 00000100:00080000:3.0:1789427945.448820:0:6484:0:(import.c:65:import_set_state_nolock()) ffff919583439000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427945.448845:0:6484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789427945.463261:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688830450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+7:2396:x1876350931685120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 15043us (15724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427945.463279:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789427945.468811:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2393:x1876350931685504:12345-192.168.202.24@tcp:39:umount.0 Request processed in 20038us (21125us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789427945.468828:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 259 00000100:00080000:3.0:1789427945.468936:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789427945.468965:0:6472:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91958343a800: total 0 00010000:00010000:3.0:1789427945.469017:0:6472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91958343a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789427945.469054:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919688862100) 00010000:00010000:3.0:1789427945.469059:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427945.469067:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5193bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ee8 expref: 4 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427945.469089:0:6472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91958343a800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789427945.469100:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427945.469102:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427945.469104:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427945.494924:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789427945.495035:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931685632 00000100:00100000:1.0:1789427945.495046:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931685632 00000100:00100000:1.0:1789427945.495123:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 260 00000100:00100000:1.0:1789427945.495134:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+5:2393:x1876350931685632:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:1.0:1789427945.495353:0:6483:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518412 00000100:00080000:1.0:1789427945.495363:0:6483:0:(import.c:65:import_set_state_nolock()) ffff91958343e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427945.495394:0:6483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1789427945.495569:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789427945.495875:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789427945.496712:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380d3950-14fb-41fe-b87d-b6d5bf049758+3:2393:x1876350931685632:12345-192.168.202.24@tcp:39:umount.0 Request processed in 1573us (1790us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789427945.496724:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 260 00000100:00100000:1.0:1789427945.545149:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789427945.545255:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931685888 00000100:00100000:2.0:1789427945.545265:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931685888 00000100:00100000:2.0:1789427945.545325:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 394 00000100:00100000:2.0:1789427945.545336:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+7:2393:x1876350931685888:12345-192.168.202.24@tcp:251:umount.0 00000020:00000080:2.0:1789427945.545388:0:6477:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182d0 00000020:00010000:2.0:1789427945.545398:0:6477:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9195837e0800: total 0 00000100:00080000:2.0:1789427945.545404:0:6477:0:(import.c:65:import_set_state_nolock()) ffff9195837e2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789427945.545546:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bd1cb55-1ed6-4846-a08c-32b278fa2427+3:2393:x1876350931685888:12345-192.168.202.24@tcp:251:umount.0 Request processed in 211us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427945.545571:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 394 00000020:00010000:0.0:1789427945.546150:0:7424:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9195837e0800: total 0 00010000:00010000:0.0:1789427945.546156:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427945.546211:0:7424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9195837e0800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789427945.546248:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429600/0x84fc867ede51832b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300a49 expref: 2 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427945.546265:0:7424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9195837e0800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789427945.546274:0:7424:0:(genops.c:885:class_export_put()) final put ffff9195837e0800/0bd1cb55-1ed6-4846-a08c-32b278fa2427 00010000:00010000:0.0:1789427945.546294:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427945.546297:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427945.546298:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789427945.546346:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e0800/0bd1cb55-1ed6-4846-a08c-32b278fa2427 for MGS 00000020:00000080:1.0:1789427945.546386:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837e2000 for MGS 00010000:00010000:2.0:1789427945.915701:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427946.291039:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427946.291064:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940111488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789427946.291135:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427946.291200:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111488 00000100:00100000:0.0:1789427946.291208:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111488 00000100:00100000:0.0:1789427946.291250:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789427946.291260:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940111488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789427946.291300:0:6487:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789427946.291346:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940111488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427946.291353:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789427946.291396:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940111488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789427946.932010:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789427947.343730:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000001:00080000:2.0:1789427947.343748:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789427947.343755:0:6462:0:(genops.c:885:class_export_put()) final put ffff91958343a800/380d3950-14fb-41fe-b87d-b6d5bf049758 00000001:00100000:2.0:1789427947.343771:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000001:00080000:2.0:1789427947.343777:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789427947.343789:0:6462:0:(genops.c:885:class_export_put()) final put ffff9195837a8000/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:3.0:1789427947.344680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91958343a800/380d3950-14fb-41fe-b87d-b6d5bf049758 for lustre-MDT0000 00000020:00000080:3.0:1789427947.344754:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837a8000/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-MDT0000 00000020:00000080:3.0:1789427947.344786:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583439000 for lustre-MDT0000 00000020:00000080:3.0:1789427947.344791:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837aa800 for lustre-MDT0000 00000020:01000004:2.0:1789427947.746741:0:15165:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789427947.766905:0:15165:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789427947.766967:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.766985:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.766992:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.766999:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.767027:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789427947.767032:0:15165:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789427947.767057:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427947.767062:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789427947.767068:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789427947.767091:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196ad8c8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789427947.767286:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940111616:0@lo:39:umount.0 00000100:00100000:3.0:1789427947.767359:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427947.767557:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427947.767565:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.767575:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427947.767579:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.767588:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427947.767595:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427947.767601:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427947.767603:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789427947.767606:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789427947.767644:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.767649:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427947.767670:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.767674:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209c00/0x84fc867ede518386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51838d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.767690:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427947.767691:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427947.767693:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427947.767705:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111616 00000100:00100000:0.0:1789427947.767710:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111616 00000100:00100000:0.0:1789427947.767751:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789427947.767759:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1876350940111616:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789427947.767792:0:10064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517ee7 00000100:00080000:0.0:1789427947.767804:0:10064:0:(import.c:65:import_set_state_nolock()) ffff9196adada000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789427947.767860:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3612:x1876350940111616:12345-0@lo:39:umount.0 Request processed in 102us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427947.767866:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1789427947.767876:0:10064:0:(genops.c:885:class_export_put()) final put ffff9196adadb000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1789427947.767900:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940111744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427947.767933:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427947.767974:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427947.767981:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adadb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789427947.768022:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196adada000 for lustre-MDT0000 00000100:00100000:0.0:1789427947.768033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111744 00000100:00100000:0.0:1789427947.768036:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111744 00000100:00100000:0.0:1789427947.768061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427947.768067:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3614:x1876350940111744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427947.768075:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427947.768086:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813edc00/0x84fc867ede51838d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518386 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.768096:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427947.768123:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3614:x1876350940111744:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427947.768127:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427947.768154:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3614:1876350940111744:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789427947.770576:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ad8c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789427947.770591:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940111616:0@lo:39:umount.0 00000100:00080000:2.0:1789427947.771661:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427947.771667:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789427947.771674:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789427947.772679:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772696:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772703:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772712:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772731:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789427947.772744:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427947.772750:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772758:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427947.772762:0:9487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772772:0:9487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427947.772780:0:9487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427947.772787:0:9487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789427947.772804:0:9487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789427947.772839:0:9487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772848:0:9487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427947.772867:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772874:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede518394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51839b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772887:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.772889:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.772890:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.772901:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772908:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772913:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772919:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772932:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789427947.772939:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427947.772943:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772960:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427947.772963:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.772970:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427947.772977:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427947.772981:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789427947.772983:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789427947.772986:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789427947.773001:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773006:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427947.773013:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773019:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919680030000/0x84fc867ede51828a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518291 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773028:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.773030:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.773032:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.773042:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773050:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773062:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773068:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773080:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789427947.773087:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773093:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773100:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773106:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773118:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789427947.773121:0:15165:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789427947.773124:0:15165:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789427947.773156:0:15165:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789427947.773160:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789427947.773165:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.773169:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1789427947.773175:0:15165:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff91958321b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427947.773181:0:15165:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9196bc9e9800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427947.773194:0:15165:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9196adae8000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427947.773200:0:15165:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9196b63fe800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789427947.773204:0:15165:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9196888a8000) has exports, disconnecting them 00000020:00080000:2.0:1789427947.773209:0:15165:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91958321b000), last request at 1789427943 00000020:00000080:2.0:1789427947.773215:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5181fe 00000100:00080000:2.0:1789427947.773232:0:15165:0:(import.c:65:import_set_state_nolock()) ffff919583219800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789427947.773267:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427947.773271:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773277:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427947.773279:0:9487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773286:0:9487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427947.773291:0:9487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427947.773296:0:9487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789427947.773298:0:9487:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789427947.773300:0:9487:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789427947.773314:0:9487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773319:0:9487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427947.773335:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773351:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583429200/0x84fc867ede5185e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185e7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773360:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427947.773363:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773368:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eca00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789427947.773371:0:9487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773378:0:9487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427947.773384:0:9487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427947.773389:0:9487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789427947.773391:0:9487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789427947.773393:0:9487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789427947.773409:0:9487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773446:0:9487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427947.773453:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773458:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede517e46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede517e4d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427947.773478:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.773480:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427947.773481:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789427947.773527:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91958321b000): rc 0 00000020:00000080:2.0:1789427947.773529:0:15165:0:(genops.c:885:class_export_put()) final put ffff91958321b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789427947.773541:0:15165:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9196bc9e9800), last request at 1789427943 00000020:00000080:2.0:1789427947.773546:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5180d8 00000100:00080000:2.0:1789427947.773552:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196bc9eb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789427947.773563:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789427947.773569:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196bc9e9800): rc 0 00000020:00000080:2.0:1789427947.773572:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196bc9e9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789427947.773576:0:15165:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9196adae8000), last request at 1789427735 00000020:00000080:2.0:1789427947.773579:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517fce 00000100:00080000:2.0:1789427947.773582:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196adae9800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789427947.773590:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789427947.773596:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196adae8000): rc 0 00000020:00000080:2.0:1789427947.773598:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196adae8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789427947.773601:0:15165:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9196b63fe800), last request at 1789427735 00000020:00000080:2.0:1789427947.773604:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f8f 00000100:00080000:2.0:1789427947.773607:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196b63fc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789427947.773617:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789427947.773622:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789427947.773709:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196b63fe800): rc 0 00000004:00000080:2.0:1789427947.773714:0:15165:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb489c798fae0 00000100:00080000:2.0:1789427947.773732:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789427947.773736:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1789427947.773990:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940112128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427947.774054:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427947.774104:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427947.774111:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940112256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427947.774134:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427947.774168:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112128 00000100:00100000:0.0:1789427947.774176:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112128 00000100:00100000:0.0:1789427947.774222:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112256 00000100:00100000:0.0:1789427947.774226:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112256 00000100:00100000:0.0:1789427947.774248:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427947.774257:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+24:3613:x1876350940112128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427947.774269:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427947.774284:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883b600/0x84fc867ede5185e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5185e0 expref: 24 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.774298:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427947.774333:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+23:3613:x1876350940112128:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427947.774340:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427947.774358:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789427947.774364:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3613:x1876350940112256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427947.774372:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427947.774381:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e8c00/0x84fc867ede517e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede517e46 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427947.774401:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427947.774452:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+21:3613:x1876350940112256:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427947.774458:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:0.0:1789427947.774485:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff91958321b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789427947.774646:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9e9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1789427947.774663:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:00000080:0.0:1789427947.774669:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adae8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1789427947.774689:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196bc9ef800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1789427947.774698:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583219800 for lustre-MDT0000 00000020:00000080:0.0:1789427947.774705:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bc9eb800 for lustre-MDT0000 00000020:00000080:0.0:1789427947.774710:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196adae9800 for lustre-MDT0000 00010000:00010000:0.0:1789427947.774723:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427947.774745:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427947.774773:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940112256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427947.774786:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940112128:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789427947.774837:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789427947.774841:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789427947.774861:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789427947.774917:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789427947.774927:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789427947.774933:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789427947.774935:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789427947.774946:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789427947.775007:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789427947.775015:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9195837e5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789427947.775040:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9196888a8000) has no exports 00000100:00100000:3.0:1789427947.775870:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940111872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427947.775907:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427947.775942:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427947.775946:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940112000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427947.775959:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427947.775981:0:7887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940111872 00000100:00100000:0.0:1789427947.775989:0:7887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940111872 00000100:00100000:3.0:1789427947.775994:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112384:0@lo:39:umount.0 00000100:00100000:2.0:1789427947.776000:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112000 00000100:00100000:2.0:1789427947.776005:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112000 00000100:00100000:3.0:1789427947.776025:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427947.776038:0:7887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427947.776047:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427947.776051:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112512:0@lo:9:umount.0 00000100:00100000:0.0:1789427947.776052:0:7887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3615:x1876350940111872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427947.776058:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+22:3615:x1876350940112000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789427947.776070:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427947.776070:0:7887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789427947.776076:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427947.776094:0:7887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428800/0x84fc867ede51839b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518394 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427947.776095:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112640:0@lo:9:umount.0 00010000:00010000:2.0:1789427947.776095:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919680030600/0x84fc867ede518291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51828a expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427947.776116:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427947.776119:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427947.776122:0:7887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427947.776148:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112512 00000100:00100000:3.0:1789427947.776153:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112512 00000100:00100000:2.0:1789427947.776156:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3615:x1876350940112000:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427947.776163:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427947.776168:0:7887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+20:3615:x1876350940111872:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427947.776185:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112640 00000100:00100000:3.0:1789427947.776190:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112640 00000100:00100000:0.0:1789427947.776190:0:7887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427947.776227:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789427947.776236:0:13777:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940112512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789427947.776257:0:13777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518179 00000100:00100000:1.0:1789427947.776258:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112384 00000100:00100000:1.0:1789427947.776264:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112384 00000100:00080000:0.0:1789427947.776269:0:13777:0:(import.c:65:import_set_state_nolock()) ffff9196b7089800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789427947.776299:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789427947.776306:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940112384:12345-0@lo:39:umount.0 00000001:00000004:0.0:1789427947.776316:0:13777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00000080:1.0:1789427947.776323:0:7439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51803e 00000100:00080000:1.0:1789427947.776329:0:7439:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427947.776343:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789427947.776484:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3612:x1876350940112384:12345-0@lo:39:umount.0 Request processed in 178us (458us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789427947.776490:0:13777:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3612:x1876350940112512:12345-0@lo:9:umount.0 Request processed in 253us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427947.776496:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1789427947.776549:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9ef800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789427947.776554:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112384:0@lo:39:umount.0 00000100:00080000:1.0:1789427947.776562:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789427947.776570:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789427947.776572:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789427947.776574:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112512:0@lo:9:umount.0 00010000:00010000:1.0:1789427947.776592:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427947.781538:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789427947.781564:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940112640:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789427947.781598:0:8401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182bb 00000100:00080000:3.0:1789427947.781609:0:8401:0:(import.c:65:import_set_state_nolock()) ffff9195837ab800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789427947.781660:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789427947.781670:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789427947.781872:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3612:x1876350940112640:12345-0@lo:9:umount.0 Request processed in 321us (5755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427947.781881:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789427947.781930:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940112000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427947.781949:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940111872:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789427947.781975:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427947.781981:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427947.782145:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195837e5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789427947.782160:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789427947.782165:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789427947.782165:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789427947.782173:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940112640:0@lo:9:umount.0 00010000:00010000:0.0:1789427947.782209:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427947.788334:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789427947.788341:0:9478:0:(genops.c:885:class_export_put()) final put ffff9195837ae800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789427947.788361:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:3.0:1789427947.788363:0:9478:0:(genops.c:885:class_export_put()) final put ffff919583caf800/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:0.0:1789427947.788388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837ae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789427947.788456:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583caf800/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-OST0001 00000020:00000080:0.0:1789427947.788477:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837ab800 for lustre-OST0001 00000020:00000080:0.0:1789427947.788482:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583cae000 for lustre-OST0001 00000020:00080000:1.0:1789427947.788961:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9196888a8000) has no exports 00000020:00000080:1.0:1789427947.831332:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517ea1 00000020:00000080:1.0:1789427947.831350:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196ad913000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789427947.831468:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789427947.831508:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad913000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789427947.831600:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427947.831611:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789427947.831616:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9196ad8d19c0) has no exports 00000020:00000080:0.0:1789427947.831904:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e9a 00000020:00000080:0.0:1789427947.831908:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196ad8cd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789427947.831945:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789427947.831957:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427947.831963:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789427947.831965:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196ad8cb800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789427947.831968:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8cb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789427947.831974:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789427947.955067:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427948.338384:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789427948.338400:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789427948.338404:0:7414:0:(genops.c:885:class_export_put()) final put ffff9196b6296800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789427948.338445:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 380d3950-14fb-41fe-b87d-b6d5bf049758 00000001:00080000:3.0:1789427948.338449:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789427948.338451:0:7414:0:(genops.c:885:class_export_put()) final put ffff919583438800/380d3950-14fb-41fe-b87d-b6d5bf049758 00000001:00100000:3.0:1789427948.338455:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000001:00080000:3.0:1789427948.338459:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789427948.338461:0:7414:0:(genops.c:885:class_export_put()) final put ffff9195837e7800/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:0.0:1789427948.338575:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b6296800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789427948.338634:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919583438800/380d3950-14fb-41fe-b87d-b6d5bf049758 for lustre-MDT0001 00000020:00000080:0.0:1789427948.338654:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e7800/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-MDT0001 00000020:00000080:0.0:1789427948.338691:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bc9e6800 for lustre-MDT0001 00000020:00000080:0.0:1789427948.338696:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91958343e800 for lustre-MDT0001 00000020:00000080:0.0:1789427948.338699:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837e1800 for lustre-MDT0001 00000001:00100000:1.0:1789427948.342373:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789427948.342383:0:8395:0:(genops.c:885:class_export_put()) final put ffff9196b708c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789427948.342409:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:1.0:1789427948.342411:0:8395:0:(genops.c:885:class_export_put()) final put ffff9196bfad1000/2f916dfa-5c35-44f7-8247-070d65680205 00000020:00000080:2.0:1789427948.342606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b708c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789427948.342653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bfad1000/2f916dfa-5c35-44f7-8247-070d65680205 for lustre-OST0000 00000020:00000080:2.0:1789427948.342690:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b7089800 for lustre-OST0000 00000020:00000080:2.0:1789427948.342696:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bfad3800 for lustre-OST0000 00000100:00100000:3.0:1789427948.848805:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940112768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427948.848883:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427948.850428:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112768 00000100:00100000:0.0:1789427948.850442:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112768 00000100:00100000:0.0:1789427948.850522:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789427948.850532:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940112768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789427948.850885:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940113152:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.850951:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.850983:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940113664:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.851004:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.851025:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789427948.851031:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940113024:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.851054:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.851069:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940113536:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.851104:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.851135:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113152 00000100:00100000:1.0:1789427948.851139:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113152 00000100:00100000:1.0:1789427948.851162:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113664 00000100:00100000:1.0:1789427948.851164:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113664 00000100:00100000:1.0:1789427948.851179:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789427948.851185:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876350940113152:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789427948.851191:0:8108:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789427948.851224:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876350940113152:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789427948.851231:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789427948.851377:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789427948.851382:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876350940113664:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789427948.851387:0:8108:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789427948.851409:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876350940113664:12345-0@lo:400:kworker.0 Request processed in 26us (404us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789427948.851434:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789427948.851452:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113024 00000100:00100000:1.0:1789427948.851455:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113024 00000100:00100000:1.0:1789427948.851474:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789427948.851478:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876350940113024:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789427948.851483:0:6488:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789427948.851517:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876350940113024:12345-0@lo:400:kworker.0 Request processed in 37us (461us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789427948.851523:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789427948.851540:0:8902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113536 00000100:00100000:1.0:1789427948.851543:0:8902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113536 00000100:00080000:3.0:1789427948.851757:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427948.851773:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940112896:0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.851807:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427948.851840:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940113408:0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.851861:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427948.851884:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789427948.851890:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940113280:0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.851931:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427948.851948:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940113792:0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.851969:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427948.852005:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113408 00000100:00100000:3.0:1789427948.852008:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113408 00000100:00100000:3.0:1789427948.852034:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113280 00000100:00100000:3.0:1789427948.852037:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113280 00000100:00100000:3.0:1789427948.852046:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113792 00000100:00100000:3.0:1789427948.852048:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113792 00000100:00100000:3.0:1789427948.852063:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789427948.852069:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940113408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.852105:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940113408:12345-0@lo:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427948.852111:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789427948.852124:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789427948.852130:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940113792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.852154:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940113792:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427948.852159:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789427948.852170:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789427948.852174:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1876350940113280:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789427948.852178:0:8108:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789427948.852196:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1876350940113280:12345-0@lo:400:kworker.0 Request processed in 21us (276us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789427948.852201:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1789427948.852214:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427948.852232:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789427948.852386:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940112896 00000100:00100000:2.0:1789427948.852391:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940112896 00000100:00100000:2.0:1789427948.852444:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789427948.852452:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3616:x1876350940112896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427948.852485:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196c19b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3616:x1876350940112896:12345-0@lo:400:kworker.0 Request processed in 35us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427948.852502:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1789427948.852564:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789427948.852569:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789427948.852572:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789427948.853478:0:8902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789427948.853487:0:8902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.854138:0:8902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940113536:12345-0@lo:400:kworker.0 Request processed in 650us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427948.854145:0:8902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1789427948.854171:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427948.854281:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789427948.854284:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789427948.854289:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789427948.854292:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 90 00000100:00080000:3.0:1789427948.854303:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9196bbdd6000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427948.854330:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196ad928000 x1876350940113920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789427948.854359:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940113280:0@lo:400:kworker.0 00010000:00080000:3.0:1789427948.854380:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c96680 x1876350940113792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427948.854390:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940113792:0@lo:400:kworker.0 00000100:00100000:3.0:1789427948.854399:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940112896:0@lo:400:kworker.0 00010000:00080000:3.0:1789427948.854408:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583c96300 x1876350940113408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427948.854429:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940113408:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.855357:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940113920:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789427948.855447:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789427948.856487:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427948.856571:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940112768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6039us (7685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427948.856579:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789427948.857819:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940113920 00000100:00100000:3.0:1789427948.857831:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940113920 00000100:00100000:3.0:1789427948.857867:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789427948.857874:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940113920:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1789427948.857890:0:8108:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789427948.859088:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940112768:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789427948.872483:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427948.872504:0:3614:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 80 00000100:00080000:2.0:1789427948.872521:0:3614:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9196bbdd7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427948.872685:0:3614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bdc00 x1876350940114048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427948.872727:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940113024:0@lo:400:kworker.0 00000100:00100000:2.0:1789427948.872765:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940113536:0@lo:400:kworker.0 00000100:00080000:2.0:1789427948.872779:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789427948.872783:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789427948.872786:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789427948.872790:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427948.872793:0:3614:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 80 00000100:00080000:2.0:1789427948.872815:0:3614:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b63f9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427948.872832:0:3614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bd180 x1876350940114176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427948.872843:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940113152:0@lo:400:kworker.0 00000100:00080000:2.0:1789427948.872856:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789427948.872859:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789427948.872862:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789427948.872865:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427948.872868:0:3614:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 99 00000100:00080000:2.0:1789427948.872872:0:3614:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9196bca84800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427948.872883:0:3614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831be300 x1876350940114304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427948.872893:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940113664:0@lo:400:kworker.0 00000100:00100000:1.0:1789427948.873288:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940114048:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789427948.873348:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.873390:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940114176:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789427948.873441:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.873461:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940114304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789427948.873483:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427948.873533:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114176 00000100:00100000:1.0:1789427948.873540:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114176 00000100:00100000:1.0:1789427948.873584:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114304 00000100:00100000:1.0:1789427948.873588:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114304 00000100:00100000:1.0:1789427948.873604:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789427948.873611:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940114176:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789427948.873627:0:10064:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789427948.873668:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940114176:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 56us (254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427948.873674:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789427948.873693:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789427948.873697:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940114304:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789427948.873715:0:10064:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789427948.873742:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940114304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427948.873748:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789427948.873779:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427948.873784:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427948.873787:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940114176:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789427948.873795:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427948.873798:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427948.873801:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940114304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789427948.873893:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114048 00000100:00100000:0.0:1789427948.873897:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114048 00000100:00100000:0.0:1789427948.873935:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789427948.873940:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940114048:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789427948.873948:0:6487:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789427948.873986:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940114048:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (636us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789427948.873992:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1789427948.874019:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789427948.874023:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789427948.874026:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940114048:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789427948.891257:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940113920:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 33373us (35834us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789427948.891272:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789427948.891471:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427948.891478:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427948.891482:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940113920:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1789427948.978195:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427949.874750:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940114432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789427949.874828:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427949.874911:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114432 00000100:00100000:3.0:1789427949.874919:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114432 00000100:00100000:3.0:1789427949.874959:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789427949.874967:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940114432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789427949.874998:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789427949.875039:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940114432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427949.875046:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789427949.875086:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940114432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789427950.001366:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427951.024805:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427952.049855:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427952.050541:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427953.080089:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427953.458826:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427953.458837:0:6462:0:(genops.c:885:class_export_put()) final put ffff9196b63fe800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789427953.459207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b63fe800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789427953.459255:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b63fc800 for lustre-MDT0000 00000020:01000000:2.0:1789427953.905200:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919583020360 - data ffff9196a9e99438/ffff91958372bc00 00000020:01000000:2.0:1789427953.905351:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9196ad9027e0 - data ffff9196897fae58/ffff9196b18f8400 00000001:00000004:2.0:1789427953.915829:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789427953.968654:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427953.968660:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427953.968664:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427953.968671:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 293 00000100:00080000:1.0:1789427953.968678:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789427953.968688:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9196bbdd7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427953.968710:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583c97800 x1876350940114688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427953.968736:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427953.968753:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427953.968755:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427953.968759:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 293 00000100:00080000:1.0:1789427953.968762:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789427953.968767:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b63f9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427953.968783:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583c94000 x1876350940114816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427953.968794:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427953.968797:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427953.968799:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427953.968802:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 293 00000100:00080000:1.0:1789427953.968804:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789427953.968809:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9196bbdd6000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427953.968817:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583c96d80 x1876350940114944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427953.968848:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427953.968852:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427953.968854:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427953.968857:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 293 00000100:00080000:1.0:1789427953.968860:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789427953.968864:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9196bca84800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427953.968873:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583df4380 x1876350940115328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789427953.968913:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940114560:0@lo:400:kworker.0 00000100:00100000:1.0:1789427953.968986:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.969034:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940115584:0@lo:400:kworker.0 00000100:00100000:1.0:1789427953.969060:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.969086:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427953.969091:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940115072:0@lo:400:kworker.0 00000100:00100000:1.0:1789427953.969112:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.969137:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940114688:0@lo:38:kworker.0 00000100:00100000:1.0:1789427953.969161:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.969177:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940114816:0@lo:38:kworker.0 00000100:00100000:3.0:1789427953.969629:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940115712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427953.969659:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427953.969881:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115712 00000100:00100000:0.0:1789427953.970079:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115712 00000100:00100000:0.0:1789427953.970135:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789427953.970144:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940115712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789427953.970180:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789427953.970236:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940115712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427953.970242:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789427953.970281:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940115712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789427953.970328:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115584 00000100:00100000:0.0:1789427953.970331:0:8401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115584 00000100:00100000:0.0:1789427953.970353:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789427953.970359:0:8401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940115584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.970388:0:8401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940115584:12345-0@lo:400:kworker.0 Request processed in 29us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427953.970394:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789427953.970409:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114560 00000100:00100000:0.0:1789427953.970428:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114560 00000100:00100000:0.0:1789427953.970461:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789427953.970467:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350940114560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.970493:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6+19:3613:x1876350940114560:12345-0@lo:400:kworker.0 Request processed in 27us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427953.970695:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.970715:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940114944:0@lo:38:kworker.0 00000100:00100000:0.0:1789427953.970787:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789427953.970819:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940115456:0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.970841:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427953.970859:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427953.970865:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940115200:0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.970884:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427953.970907:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115200 00000100:00100000:0.0:1789427953.970910:0:8402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115200 00000100:00100000:0.0:1789427953.970941:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789427953.970947:0:8402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.970976:0:8402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940115200:12345-0@lo:400:kworker.0 Request processed in 30us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427953.970982:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789427953.971006:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115072 00000100:00100000:0.0:1789427953.971008:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115072 00000100:00100000:0.0:1789427953.971030:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114816 00000100:00100000:0.0:1789427953.971032:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114816 00000100:00100000:0.0:1789427953.971041:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115456 00000100:00100000:0.0:1789427953.971043:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115456 00000100:00100000:0.0:1789427953.971054:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789427953.971059:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940115072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.971084:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940115072:12345-0@lo:400:kworker.0 Request processed in 25us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427953.971090:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789427953.971099:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789427953.971104:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940115456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.971123:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940115456:12345-0@lo:400:kworker.0 Request processed in 20us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427953.971129:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789427953.971137:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789427953.971141:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940114816:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789427953.971152:0:6482:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789427953.971269:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427953.971283:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940115328:0@lo:38:kworker.0 00000100:00100000:3.0:1789427953.971405:0:8108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114944 00000100:00100000:3.0:1789427953.971409:0:8108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114944 00000100:00100000:3.0:1789427953.971452:0:8108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789427953.971458:0:8108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940114944:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789427953.971465:0:8108:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789427953.971494:0:8108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940114944:12345-0@lo:38:kworker.0 Request processed in 36us (225us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789427953.971508:0:8108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789427953.971631:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789427953.971660:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427953.971664:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427953.971667:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940114944:0@lo:38:kworker.0 00000100:00100000:1.0:1789427953.971688:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115328 00000100:00100000:1.0:1789427953.971692:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115328 00000100:00100000:1.0:1789427953.971707:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789427953.971712:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940115328:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789427953.971720:0:10064:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1789427953.972009:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789427953.972015:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427953.972017:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427953.972027:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940114688 00000100:00100000:3.0:1789427953.972039:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940114688 00000100:00100000:3.0:1789427953.972060:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789427953.972065:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940114688:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789427953.972073:0:7439:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789427953.972107:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940114688:12345-0@lo:38:kworker.0 Request processed in 41us (2946us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789427953.972113:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:3.0:1789427953.972142:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4380 x1876350940115072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427953.972154:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940115072:0@lo:400:kworker.0 00000100:00100000:3.0:1789427953.972163:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940114560:0@lo:400:kworker.0 00000100:00100000:3.0:1789427953.972172:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940115584:0@lo:400:kworker.0 00000100:00100000:1.0:1789427953.972841:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940115328:12345-0@lo:38:kworker.0 Request processed in 1127us (1209us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427953.972849:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1789427953.972889:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427953.972894:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427953.972897:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940114688:0@lo:38:kworker.0 00000100:00080000:1.0:1789427953.972905:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427953.972908:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427953.972910:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940115328:0@lo:38:kworker.0 00000100:00100000:1.0:1789427953.972955:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940115200:0@lo:400:kworker.0 00010000:00080000:1.0:1789427953.972967:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583df4e00 x1876350940115456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427953.972976:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940115456:0@lo:400:kworker.0 00000100:00100000:0.0:1789427953.997137:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940114816:12345-0@lo:38:kworker.0 Request processed in 25984us (26431us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789427953.997153:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1789427954.004958:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789427954.004972:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789427954.004977:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940114816:0@lo:38:kworker.0 00000100:00080000:2.0:1789427954.011625:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789427954.011651:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789427954.011664:0:15165:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9195831bd880 x1876350940112384/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789427957 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427954.011690:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789427954.024719:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789427954.024739:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789427954.024760:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427954.024763:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789427954.025150:0:8900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789427954.025154:0:8900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789427954.025163:0:8900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789427954.025831:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789427954.025835:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789427954.025853:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427954.025855:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789427954.026516:0:9931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789427954.026520:0:9931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789427954.026529:0:9931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789427954.031368:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e69 00000020:00000080:2.0:1789427954.031380:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196a9817000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789427954.032401:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9817000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427954.037577:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e7e 00000020:00000080:2.0:1789427954.037590:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196a9814800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789427954.037637:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789427954.037642:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427954.037650:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789427954.037653:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9196888ab380) has no exports 00000004:01000000:2.0:1789427954.037821:0:15165:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789427954.037828:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182b4 00000020:00000080:2.0:1789427954.037832:0:15165:0:(genops.c:885:class_export_put()) final put ffff9195837e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789427954.041230:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9814800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789427954.047593:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789427954.047832:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789427954.047855:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427954.047871:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789427954.047876:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9195830299c0) has no exports 00000020:00000080:1.0:1789427954.047885:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5182ad 00000020:00000080:1.0:1789427954.047894:0:15165:0:(genops.c:885:class_export_put()) final put ffff9195837e0000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789427954.048378:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789427954.048383:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789427954.048388:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789427954.048394:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789427954.048397:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427954.048484:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427954.048493:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789427954.048501:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518172 00000020:00000080:1.0:1789427954.048523:0:15165:0:(genops.c:885:class_export_put()) final put ffff9195826c3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789427954.048529:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789427954.048533:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427954.048539:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789427954.048542:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9196bf988000) has no exports 00000020:00000080:1.0:1789427954.048547:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51816b 00000020:00000080:1.0:1789427954.048550:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196bc9ee000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789427954.048878:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789427954.048881:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789427954.048883:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789427954.048887:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789427954.048888:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427954.048913:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427954.048918:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789427954.048929:0:15165:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789427954.048935:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518037 00000020:00000080:1.0:1789427954.048940:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196bca11000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789427954.048943:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789427954.048946:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427954.048949:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789427954.048951:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff919688450000) has no exports 00000020:00000080:1.0:1789427954.048955:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518030 00000020:00000080:1.0:1789427954.048957:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196bc9ea800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789427954.049985:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789427954.049998:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195837e5800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789427954.050004:0:469:0:(genops.c:885:class_export_put()) final put ffff9195837e7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427954.050006:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789427954.050011:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427954.050089:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195826c3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789427954.050093:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789427954.050098:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bc9e8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789427954.050102:0:469:0:(genops.c:885:class_export_put()) final put ffff9195826c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427954.050104:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195826c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789427954.050107:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427954.050130:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca11000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789427954.050134:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789427954.121541:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789427954.121551:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789427954.121556:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789427954.121565:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789427954.121633:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.121644:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427954.121669:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.121672:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427954.121678:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196877f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427954.121683:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9196877f0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789427954.121708:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427954.121815:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e85 00000020:00000080:0.0:1789427954.121822:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196a9815800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789427954.121827:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789427954.121830:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.121834:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789427954.121838:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9196888acd40) has no exports 00000020:00000080:0.0:1789427954.121855:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.121858:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789427954.121861:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e8c 00000020:00000080:0.0:1789427954.121864:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196a9810000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789427954.121872:0:15165:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919684ed8800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789427954.121875:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919684ed8800 3 00000020:01000004:0.0:1789427954.121878:0:15165:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919684ed8800 from lustre-MDT0000 00000020:00000080:0.0:1789427954.121896:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.121898:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789427954.121901:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196a9813000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789427954.121903:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9813000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789427954.121910:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789427954.121934:0:15165:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789427954.121937:0:15165:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789427954.121939:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789427954.121941:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.121944:0:15165:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427954.121950:0:15165:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff919689277000 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427954.121956:0:15165:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff919688894d40) has exports, disconnecting them 00000020:00080000:0.0:1789427954.121959:0:15165:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff919689277000), last request at 1789427727 00000020:00000080:0.0:1789427954.121972:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e2a 00000020:00010000:0.0:1789427954.121975:0:15165:0:(genops.c:1920:obd_stale_export_put()) Put export ffff919689277000: total 2 00000100:00080000:0.0:1789427954.121979:0:15165:0:(import.c:65:import_set_state_nolock()) ffff919688809000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789427954.121989:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919689277000): rc 0 00000020:00080000:0.0:1789427954.121998:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff919688894d40) has no exports 00000100:00100000:0.0:1789427954.122048:0:6477:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff919698e8ce00:6477] 1 exiting: rc = 0 00000100:00100000:0.0:1789427954.122148:0:6475:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9196c198de00:6475] 0 exiting: rc = 1 00000020:00010000:2.0:1789427954.122284:0:7424:0:(genops.c:1906:obd_stale_export_get()) Get export ffff919689277000: total 2 00010000:00010000:2.0:1789427954.122328:0:7424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff919689277000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789427954.122359:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883ae00/0x84fc867ede5183a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5183a2 expref: 14 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122376:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428200/0x84fc867ede518339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518332 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122400:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e8e00/0x84fc867ede51824b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518244 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122453:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209400/0x84fc867ede518347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518340 expref: 11 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122465:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428a00/0x84fc867ede518355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51834e expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122475:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91968883b200/0x84fc867ede518371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51836a expref: 9 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122484:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e8600/0x84fc867ede517f26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede517f1f expref: 8 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122504:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965600/0x84fc867ede5185bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5185b6 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122514:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429c00/0x84fc867ede518363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51835c expref: 6 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122524:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919699965000/0x84fc867ede5185cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5185c4 expref: 5 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122534:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428600/0x84fc867ede5185d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5185d2 expref: 4 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122546:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813eda00/0x84fc867ede51837f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede518378 expref: 3 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122570:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208200/0x84fc867ede517f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede517f2d expref: 2 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.122579:0:7424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff919689277000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789427954.122594:0:7424:0:(genops.c:885:class_export_put()) final put ffff919689277000/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 00010000:00010000:2.0:1789427954.122601:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427954.122603:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427954.122605:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427954.122635:0:6478:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9196a0795e00:6478] 2 exiting: rc = 0 00000020:00000080:2.0:1789427954.122682:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bc9ef800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789427954.122689:0:469:0:(genops.c:885:class_export_put()) final put ffff9196bc9ee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789427954.122692:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9ee800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789427954.122698:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427954.122735:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9815800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789427954.122738:0:469:0:(genops.c:885:class_export_put()) final put ffff9196a9816800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789427954.122740:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9816800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789427954.122743:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789427954.122768:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9810000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427954.122773:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919689277000/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 for MGS 00000020:00000080:2.0:1789427954.122797:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919688809000 for MGS 00000100:00100000:0.0:1789427954.122970:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.122978:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.122984:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.122991:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123002:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123007:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123013:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123019:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123025:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123030:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123035:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123041:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123048:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123054:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123060:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123066:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123072:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123078:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123083:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123088:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123093:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123099:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123105:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123110:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123116:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123122:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123129:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123135:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123140:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123144:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123150:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123162:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123167:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123172:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123178:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123184:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123190:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123196:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123202:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123208:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123213:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123219:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123224:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123229:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123235:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123240:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123245:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123251:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123256:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123260:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123265:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123272:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123277:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123283:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123288:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123293:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123299:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123305:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123310:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123315:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123319:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123324:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123329:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.123334:0:15165:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789427954.128456:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91958335ccc0 - data ffff919689735e58/ffff9195830afc00 00000020:01000000:0.0:1789427954.128673:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91968847b6c0 - data ffff9196a9c5d6c0/ffff919688803c00 00000020:00000080:0.0:1789427954.129174:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e0e 00000020:00000080:0.0:1789427954.129183:0:15165:0:(genops.c:885:class_export_put()) final put ffff919683dfd000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789427954.129242:0:15165:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919684ed8800 from MGS, refs=2 00000020:01000004:0.0:1789427954.129246:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919684ed8800 2 00000020:01000004:0.0:1789427954.129249:0:15165:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919684ed8800 from MGS 00000020:00000080:0.0:1789427954.129269:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.129275:0:15165:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789427954.129278:0:15165:0:(genops.c:885:class_export_put()) final put ffff919687fbd000/MGS 00000020:00000080:0.0:1789427954.129281:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff919687fbd000/MGS for MGS 00000020:01000000:0.0:1789427954.129287:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789427954.129354:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789427954.129359:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.129364:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427954.129371:0:15165:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9196ad914800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427954.129376:0:15165:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9196ad8d3380) has exports, disconnecting them 00000020:00080000:0.0:1789427954.129381:0:15165:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9196ad914800), last request at 1789427727 00000020:00000080:0.0:1789427954.129385:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517ed9 00000020:00080000:0.0:1789427954.129394:0:15165:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196ad914800): rc 0 00000020:00000080:0.0:1789427954.129398:0:15165:0:(genops.c:885:class_export_put()) final put ffff9196ad914800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789427954.138481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919683dfd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427954.142903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad914800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789427954.347338:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789427954.347347:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789427954.347352:0:15165:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789427954.347358:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427954.347554:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427954.347563:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789427954.347569:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919684ed8800 1 00000020:00000080:1.0:1789427954.347576:0:15165:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e00 00000020:00000080:1.0:1789427954.347585:0:15165:0:(genops.c:885:class_export_put()) final put ffff919687fbf800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789427954.347601:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789427954.347605:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427954.347610:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789427954.347614:0:15165:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9196888a99c0) has no exports 00000020:00000080:2.0:1789427954.348222:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196ad8c8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789427954.348230:0:37:0:(genops.c:885:class_export_put()) final put ffff9196ad916000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789427954.348233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad916000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789427954.348239:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789427954.348580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919687fbf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789427955.003546:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940115840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789427955.003625:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427955.003904:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940115840 00000100:00100000:0.0:1789427955.003913:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940115840 00000100:00100000:0.0:1789427955.003977:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789427955.003988:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940115840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427955.004019:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789427955.004063:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940115840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427955.004071:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1789427955.004652:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427955.004705:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940115840:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789427955.073582:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789427955.077229:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427955.077242:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789427955.077248:0:15165:0:(genops.c:885:class_export_put()) final put ffff919684eda000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789427955.077253:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff919684eda000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789427955.077259:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789427955.077378:0:15165:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff919684edf000 00000020:02000400:2.0:1789427955.077477:0:15165:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789427956.081883:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427957.104955:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427958.129589:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789427959.089462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427959.089470:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427959.089474:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427959.089482:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 298 00000100:00080000:1.0:1789427959.089488:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789427959.089500:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9196bbdd7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427959.089524:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583df4a80 x1876350940116096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427959.089539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427959.089543:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427959.089545:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427959.089548:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 298 00000100:00080000:1.0:1789427959.089550:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789427959.089555:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b63f9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427959.089566:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583df5500 x1876350940116224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427959.089576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427959.089585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427959.089587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427959.089591:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 298 00000100:00080000:1.0:1789427959.089593:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789427959.089609:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9196bbdd6000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427959.089624:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583df6d80 x1876350940116352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427959.089667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427959.089671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789427959.089672:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789427959.089676:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 298 00000100:00080000:1.0:1789427959.089678:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789427959.089683:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9196bca84800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789427959.089693:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583df6680 x1876350940116736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789427959.089732:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940115968:0@lo:400:kworker.0 00000400:00000100:1.0:1789427959.089777:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940115968 offset 0 length 224: 4 00000100:00100000:1.0:1789427959.089820:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940116992:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.089848:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.089872:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427959.089877:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940116864:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.089899:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.089923:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940116096:0@lo:38:kworker.0 00000100:00100000:1.0:1789427959.089943:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.089964:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940116224:0@lo:38:kworker.0 00000100:00100000:1.0:1789427959.089982:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.089996:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940116352:0@lo:38:kworker.0 00000100:00100000:1.0:1789427959.090014:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.090027:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940116736:0@lo:38:kworker.0 00000100:00100000:1.0:1789427959.090045:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.090067:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940116608:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090087:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.090103:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427959.090107:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940116480:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090124:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427959.090150:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116992 00000100:00100000:1.0:1789427959.090157:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116992 00000100:00100000:1.0:1789427959.090203:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116608 00000100:00100000:1.0:1789427959.090206:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116608 00000100:00100000:1.0:1789427959.090226:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789427959.090234:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940116992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090280:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940116992:12345-0@lo:400:kworker.0 Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427959.090287:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789427959.090303:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789427959.090309:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940116608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090337:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940116608:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427959.090342:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789427959.090357:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116864 00000100:00100000:1.0:1789427959.090366:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116864 00000100:00100000:1.0:1789427959.090385:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116224 00000100:00100000:1.0:1789427959.090388:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116224 00000100:00100000:1.0:1789427959.090409:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789427959.090435:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090467:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940116864:12345-0@lo:400:kworker.0 Request processed in 52us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427959.090473:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789427959.090484:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116352 00000100:00100000:1.0:1789427959.090487:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116352 00000100:00100000:1.0:1789427959.090495:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116736 00000100:00100000:1.0:1789427959.090497:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116736 00000100:00100000:1.0:1789427959.090504:0:10064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116480 00000100:00100000:1.0:1789427959.090506:0:10064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116480 00000100:00100000:1.0:1789427959.090522:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789427959.090527:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940116480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090552:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940116480:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427959.090557:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789427959.090568:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789427959.090572:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789427959.090588:0:10064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789427959.090617:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116224:12345-0@lo:38:kworker.0 Request processed in 43us (634us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427959.090624:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789427959.090634:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789427959.090639:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789427959.090647:0:10064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789427959.090674:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116352:12345-0@lo:38:kworker.0 Request processed in 34us (660us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427959.090680:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789427959.090692:0:10064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789427959.090696:0:10064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116736:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789427959.090704:0:10064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789427959.090723:0:10064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3612:x1876350940116736:12345-0@lo:38:kworker.0 Request processed in 26us (677us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427959.090728:0:10064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:1.0:1789427959.090755:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789427959.090759:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427959.090761:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789427959.090793:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff919583df5c00 x1876350940116864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427959.090807:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940116864:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090819:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940116992:0@lo:400:kworker.0 00010000:00080000:1.0:1789427959.090846:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff919583df7100 x1876350940116480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427959.090854:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940116480:0@lo:400:kworker.0 00000100:00100000:1.0:1789427959.090863:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940116608:0@lo:400:kworker.0 00000100:00080000:1.0:1789427959.090884:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427959.090889:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427959.090892:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940116224:0@lo:38:kworker.0 00000100:00080000:1.0:1789427959.090899:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427959.090908:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427959.090912:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940116352:0@lo:38:kworker.0 00000100:00080000:1.0:1789427959.090923:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427959.090926:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789427959.090929:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940116736:0@lo:38:kworker.0 00000100:00100000:3.0:1789427959.091890:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940117120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789427959.091939:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427959.091987:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940116096 00000100:00100000:3.0:1789427959.091994:0:7439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940116096 00000100:00100000:3.0:1789427959.092021:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789427959.092027:0:7439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940116096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789427959.092040:0:7439:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789427959.092076:0:7439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940116096:12345-0@lo:38:kworker.0 Request processed in 48us (2131us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789427959.092083:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789427959.092102:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940117120 00000100:00100000:3.0:1789427959.092105:0:10314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940117120 00000100:00100000:3.0:1789427959.092127:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789427959.092141:0:10314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940117120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789427959.092162:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789427959.092195:0:10314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940117120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427959.092201:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789427959.092233:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789427959.092238:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789427959.092241:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940116096:0@lo:38:kworker.0 00000100:00100000:3.0:1789427959.092269:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940117120:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789427959.157838:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427960.112992:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940117248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789427960.113091:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427960.113182:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940117248 00000100:00100000:0.0:1789427960.113193:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940117248 00000100:00100000:0.0:1789427960.113254:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789427960.113265:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940117248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789427960.113302:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789427960.113348:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940117248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427960.113355:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789427960.116884:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940117248:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789427960.177158:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789427960.595326:0:15367:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789427960.613856:0:15367:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789427960.614026:0:15367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.614049:0:15367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.614057:0:15367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.614066:0:15367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.614158:0:15367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789427960.614166:0:15367:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789427960.614221:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427960.614227:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789427960.614235:0:15367:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789427960.614243:0:15367:0:(import.c:65:import_set_state_nolock()) ffff9196b63f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789427960.614249:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427960.614250:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789427960.614254:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789427960.615254:0:15367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.615270:0:15367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.615279:0:15367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.615286:0:15367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616199:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427960.616212:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616225:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427960.616230:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616242:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427960.616251:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427960.616258:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427960.616261:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789427960.616264:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789427960.616316:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616323:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789427960.616445:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789427960.616477:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616486:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede51836a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede518371 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616522:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427960.616525:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616531:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427960.616534:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616540:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427960.616546:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427960.616552:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427960.616555:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1789427960.616568:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.616575:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789427960.616628:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427960.616656:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940117504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427960.616752:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427960.616837:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940117504 00000100:00100000:2.0:1789427960.616847:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940117504 00000100:00100000:2.0:1789427960.616929:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427960.616938:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1876350940117504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789427960.616945:0:6469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789427960 with bad export cookie 9582681986591456810 00010000:00010000:0.0:1789427960.617788:0:15367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789427960.617809:0:15367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617822:0:15367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617831:0:15367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617839:0:15367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617888:0:15367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789427960.617905:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427960.617911:0:9487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617919:0:9487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427960.617923:0:9487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617931:0:9487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427960.617939:0:9487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427960.617946:0:9487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427960.617948:0:9487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789427960.617951:0:9487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789427960.617981:0:9487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.617989:0:9487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427960.618009:0:9487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.618017:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede518244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51824b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427960.618040:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427960.618048:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427960.618050:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427960.618069:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940117632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427960.618128:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427960.618184:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940117632 00000100:00100000:0.0:1789427960.618192:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940117632 00000100:00100000:0.0:1789427960.618224:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789427960.618231:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688830850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3613:x1876350940117632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789427960.618237:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789427960 with bad export cookie 9582681986591456810 00000100:00100000:0.0:1789427960.618289:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688830850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3613:x1876350940117632:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (160us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789427960.618297:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789427960.618341:0:3613:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789427960.618347:0:3613:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789427960.618351:0:3613:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1789427960.618782:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.618793:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91968883a600/0x84fc867ede518378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51837f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.618806:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.618808:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.618810:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.618827:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.619550:0:15367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619566:0:15367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619574:0:15367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619582:0:15367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619601:0:15367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789427960.619608:0:15367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619616:0:15367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619623:0:15367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619629:0:15367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619641:0:15367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789427960.619646:0:15367:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789427960.619652:0:15367:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789427960.619700:0:15367:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789427960.619705:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789427960.619720:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427960.619728:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789427960.619735:0:15367:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff91958343b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789427960.619741:0:15367:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9195826c4000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789427960.619747:0:15367:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9196ad8d4d40) has exports, disconnecting them 00000020:00080000:1.0:1789427960.619753:0:15367:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91958343b000), last request at 1789427959 00000020:00000080:1.0:1789427960.619763:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51820c 00000100:00080000:1.0:1789427960.619784:0:15367:0:(import.c:65:import_set_state_nolock()) ffff91958343f000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789427960.619833:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427960.619839:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619847:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427960.619851:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.619870:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427960.619879:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427960.619886:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789427960.619888:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789427960.619890:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1789427960.627571:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1876350940117504:12345-0@lo:103:ldlm_bl.0 Request processed in 10623us (10810us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789427960.627588:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789427960.627681:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789427960.636570:0:3613:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.124@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789427960.636578:0:3613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789427960.636592:0:3613:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff919583df4380 x1876350940115968/t0(0) o400->MGC192.168.202.124@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789427975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427960.636613:0:3613:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bf9f8a80 x1876350940117504/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789427976 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427960.636624:0:3613:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff919583fc9180 x1876350940117632/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789427976 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789427960.636644:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789427960.636647:0:3613:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789427960.636649:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789427960.636709:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:0:1876350940117376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427960.636740:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3616:1876350940115968:0@lo:400:kworker.0 00010000:00010000:1.0:1789427960.637668:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.637685:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427960.637726:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.637756:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919699965c00/0x84fc867ede5185d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5185d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.637781:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427960.637787:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.637795:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427960.637800:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.637813:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427960.637822:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427960.637828:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427960.637831:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789427960.637837:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789427960.637855:0:6472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:1.0:1789427960.638002:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.638012:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede517f2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede517f34 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427960.638031:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.638033:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427960.638042:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789427960.638075:0:15367:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91958343b000): rc 0 00000020:00000080:1.0:1789427960.638080:0:15367:0:(genops.c:885:class_export_put()) final put ffff91958343b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789427960.638102:0:15367:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9195826c4000), last request at 1789427959 00000020:00000080:1.0:1789427960.638111:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5180e6 00000100:00080000:1.0:1789427960.638125:0:15367:0:(import.c:65:import_set_state_nolock()) ffff9195826c1800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789427960.638146:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789427960.638155:0:15367:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9195826c4000): rc 0 00000020:00000080:1.0:1789427960.638157:0:15367:0:(genops.c:885:class_export_put()) final put ffff9195826c4000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789427960.638166:0:15367:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb489c19cbae0 00000100:00080000:1.0:1789427960.638191:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789427960.638196:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789427960.640822:0:15367:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789427960.640839:0:15367:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789427960.641324:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789427960.641330:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1789427960.641354:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789427960.641513:0:15367:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789427960.641550:0:15367:0:(import.c:65:import_set_state_nolock()) ffff9196bcc8d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789427960.641570:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789427960.641573:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789427960.641582:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789427960.641651:0:15367:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789427960.641660:0:15367:0:(import.c:65:import_set_state_nolock()) ffff919583030800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789427960.641692:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9196ad8d4d40) has no exports 00000100:00100000:3.0:1789427960.641786:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940117888:0@lo:9:umount.0 00000100:00100000:3.0:1789427960.641987:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427960.642049:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940118016:0@lo:9:umount.0 00000100:00100000:3.0:1789427960.642074:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427960.642125:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940117888 00000100:00100000:3.0:1789427960.642135:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940117888 00000100:00100000:3.0:1789427960.642186:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940118016 00000100:00100000:3.0:1789427960.642188:0:8400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940118016 00000100:00100000:3.0:1789427960.642211:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789427960.642221:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3612:x1876350940117888:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789427960.642253:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518133 00000100:00080000:3.0:1789427960.642265:0:8400:0:(import.c:65:import_set_state_nolock()) ffff9196bcc8d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427960.642319:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789427960.642617:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3612:x1876350940117888:12345-0@lo:9:umount.0 Request processed in 396us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427960.642625:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789427960.642643:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789427960.642649:0:8400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3612:x1876350940118016:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789427960.642661:0:8400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518283 00000100:00080000:3.0:1789427960.642667:0:8400:0:(import.c:65:import_set_state_nolock()) ffff9196bca82000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427960.642693:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789427960.642768:0:8400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3612:x1876350940118016:12345-0@lo:9:umount.0 Request processed in 119us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427960.642774:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1789427960.642802:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789427960.642835:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bcc8d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789427960.642846:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789427960.642849:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789427960.642853:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940117888:0@lo:9:umount.0 00000100:00080000:3.0:1789427960.643024:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583030800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789427960.643042:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789427960.643043:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789427960.643046:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940118016:0@lo:9:umount.0 00010000:00010000:3.0:1789427960.643076:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427960.643171:0:3615:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91968382b000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789427960.643206:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3615:1876350940117504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789427960.643357:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427960.643363:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789427960.643395:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff91958343b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:3.0:1789427960.643593:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:0:1876350940117760:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789427960.643678:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9195826c4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789427960.643720:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91958343f000 for lustre-MDT0001 00000020:00000080:2.0:1789427960.643743:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9195826c1800 for lustre-MDT0001 00000100:00080000:0.0:1789427960.644349:0:3613:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789427960.644356:0:3613:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 72 00000100:00080000:0.0:1789427960.644392:0:3613:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff91968382b000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789427960.644804:0:3613:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc9500 x1876350940118144/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427960.644848:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3613:1876350940117632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427960.644955:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940118144:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789427960.645011:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940118144 offset 0 length 520: 4 00000020:00080000:3.0:1789427960.649920:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9196ad8d4d40) has no exports 00000020:01000000:2.0:1789427960.719581:0:15367:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91958335c0c0 - data ffff919689735360/ffff9195830ad400 00000020:01000000:2.0:1789427960.719951:0:15367:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919690703ba0 - data ffff9196a9c4e000/ffff9196bbd83800 00000001:00000004:2.0:1789427960.735111:0:15367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789427960.802850:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427960.802859:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789427960.802868:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789427960.808660:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789427960.808667:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789427960.808690:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789427960.808692:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789427960.814308:0:8892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789427960.814321:0:8892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1789427960.814356:0:8892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789427960.815497:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789427960.815506:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789427960.815528:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789427960.815531:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789427960.815986:0:9927:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789427960.815991:0:9927:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789427960.816001:0:9927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789427960.817066:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f50 00000020:00000080:0.0:1789427960.817076:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbdd9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789427960.817561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdd9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789427960.821146:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f65 00000020:00000080:1.0:1789427960.821162:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbdd8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789427960.821189:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789427960.821195:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427960.821204:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789427960.821208:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9196ad8d0000) has no exports 00000004:01000000:1.0:1789427960.821365:0:15367:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789427960.821373:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51826e 00000020:00000080:1.0:1789427960.821388:0:15367:0:(genops.c:885:class_export_put()) final put ffff9195837ae000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789427960.821393:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789427960.821396:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427960.821403:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789427960.821406:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff91958302cd40) has no exports 00000020:00000080:1.0:1789427960.821411:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518267 00000020:00000080:1.0:1789427960.821698:0:15367:0:(genops.c:885:class_export_put()) final put ffff919583032000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789427960.822056:0:15367:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789427960.822060:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789427960.822063:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789427960.822069:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789427960.822071:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427960.822103:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427960.822110:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789427960.822115:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51812c 00000020:00000080:1.0:1789427960.822120:0:15367:0:(genops.c:885:class_export_put()) final put ffff9195826c5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789427960.822124:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789427960.822128:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427960.822131:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789427960.822133:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff919688890000) has no exports 00000020:00000080:1.0:1789427960.822137:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518125 00000020:00000080:1.0:1789427960.822140:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bcc88000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789427960.823095:0:15367:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789427960.823101:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789427960.823113:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789427960.823118:0:15367:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789427960.823120:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427960.823150:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427960.823157:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789427960.823169:0:15367:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789427960.823175:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f88 00000020:00000080:1.0:1789427960.823181:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196b63f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789427960.823295:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdd8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789427960.823304:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9195837ae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789427960.823309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583032000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789427960.823315:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583030800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789427960.823321:0:37:0:(genops.c:885:class_export_put()) final put ffff91958343b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789427960.823323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91958343b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789427960.823327:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789427960.823431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9195826c5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789427960.823445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc88000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789427960.823450:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bcc8d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789427960.823460:0:37:0:(genops.c:885:class_export_put()) final put ffff9196bc9e9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789427960.823462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9e9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789427960.823465:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789427960.824216:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789427960.824222:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427960.824228:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789427960.824232:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff919688893380) has no exports 00000020:00000080:1.0:1789427960.824237:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f81 00000020:00000080:1.0:1789427960.824242:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbdd2800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789427960.825611:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b63f8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789427960.825625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdd2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789427960.829854:0:15367:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789427960.829864:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427960.829868:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789427960.829877:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789427960.829943:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427960.829954:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789427960.829981:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbdd7800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789427960.829991:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427960.829998:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789427960.830005:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196adaec000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427960.830006:0:37:0:(genops.c:885:class_export_put()) final put ffff9196bbdd6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427960.830020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdd6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789427960.830020:0:15367:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adaec000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789427960.830050:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789427960.830051:0:15367:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789427960.830362:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f6c 00000020:00000080:0.0:1789427960.830372:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbdde000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789427960.830396:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789427960.830400:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427960.830405:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789427960.830408:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9196bbde19c0) has no exports 00000020:00000080:0.0:1789427960.830455:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427960.830459:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789427960.830463:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f73 00000020:00000080:0.0:1789427960.830466:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbdda000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789427960.830473:0:15367:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196adadd000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789427960.830477:0:15367:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196adadd000 2 00000020:01000004:0.0:1789427960.830480:0:15367:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196adadd000 from lustre-MDT0001 00000020:00000080:0.0:1789427960.830497:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427960.830513:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789427960.830517:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196bbddc000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789427960.830519:0:15367:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbddc000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789427960.830526:0:15367:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789427960.830556:0:15367:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789427960.830559:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789427960.830562:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427960.830565:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427960.830572:0:15367:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9196b63fb800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427960.830577:0:15367:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff919688453380) has exports, disconnecting them 00000020:00080000:0.0:1789427960.830581:0:15367:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9196b63fb800), last request at 1789427735 00000020:00000080:0.0:1789427960.830585:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517fc7 00000020:00080000:0.0:1789427960.830597:0:15367:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196b63fb800): rc 0 00000020:00000080:0.0:1789427960.830840:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196b63fb800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789427960.831178:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdde000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789427960.831186:0:37:0:(genops.c:885:class_export_put()) final put ffff9196bbdd9000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789427960.831189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdd9000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789427960.831194:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1789427960.832568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbdda000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789427960.832578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b63fb800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789427961.059969:0:15367:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789427961.059979:0:15367:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789427961.059983:0:15367:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789427961.059991:0:15367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789427961.060021:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b63f9000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789427961.060405:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789427961.060429:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789427961.060436:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196b63ff800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789427961.060440:0:15367:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b63ff800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789427961.060447:0:15367:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789427961.060971:0:15367:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196adadd000 1 00000020:00000080:3.0:1789427961.060978:0:15367:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517f03 00000020:00000080:3.0:1789427961.060985:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196873f0800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789427961.060996:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789427961.061007:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196873f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789427961.061017:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789427961.061023:0:15367:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789427961.061027:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9196884519c0) has no exports 00010000:00010000:3.0:1789427961.204935:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427961.400121:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427961.400138:0:15367:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789427961.400145:0:15367:0:(genops.c:885:class_export_put()) final put ffff9196adadc000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789427961.400149:0:15367:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adadc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789427961.400162:0:15367:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789427961.400298:0:15367:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9196adade000 00000020:01000000:0.0:1789427961.400320:0:15367:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789427961.400324:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427961.400328:0:15367:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789427961.400332:0:15367:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9196888919c0) has no exports 00000100:00100000:3.0:1789427961.401212:0:6483:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff91968843e400:6483] 1 exiting: rc = 0 00000100:00100000:3.0:1789427961.401345:0:8108:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9196b62f7e00:8108] 3 exiting: rc = 0 00000100:00100000:1.0:1789427961.401834:0:10064:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9196bcbd6200:10064] 4 exiting: rc = 0 00000100:00100000:1.0:1789427961.401919:0:6482:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff91968370de00:6482] 0 exiting: rc = 1 00000100:00100000:2.0:1789427961.406563:0:6484:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff91968843ee00:6484] 2 exiting: rc = 0 00000100:00100000:1.0:1789427961.407062:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407072:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407079:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407085:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407091:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407096:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407101:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407106:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407111:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407116:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407121:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407126:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407131:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407137:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407142:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407147:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407153:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407158:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407178:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407184:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407189:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407195:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407201:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407207:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407212:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407218:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407223:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407228:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407233:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407239:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407244:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407250:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407256:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407261:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407267:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407271:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407275:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407280:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407285:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407289:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407294:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407299:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407304:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407309:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407314:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407320:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407325:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407330:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407349:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407358:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407365:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407371:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407386:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407403:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407409:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407430:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407437:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407441:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407446:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407451:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407457:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407461:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407466:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.407471:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.420155:0:6485:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91968843ec00:6485] 0 exiting: rc = 1 00000100:00100000:0.0:1789427961.422276:0:6486:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91968843e600:6486] 1 exiting: rc = 0 00000100:00100000:0.0:1789427961.425507:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425520:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425526:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425532:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425538:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425545:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425564:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425570:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425577:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425583:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425589:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425605:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425615:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425620:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425626:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425631:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425636:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425641:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425647:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425653:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425658:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425663:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425669:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425683:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425689:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425694:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425699:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425704:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425709:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425714:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425720:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425725:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425730:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425736:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425741:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425746:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425751:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425756:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425761:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425766:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425771:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425783:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425788:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425793:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425798:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425804:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425809:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425814:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425819:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425824:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425830:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425835:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425840:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425844:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425850:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425855:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425861:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425866:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425871:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425876:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425881:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425886:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425891:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.425897:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.426474:0:6488:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff91968843f400:6488] 1 exiting: rc = 0 00000100:00100000:2.0:1789427961.429760:0:7439:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9196bc976800:7439] 2 exiting: rc = 0 00000100:00100000:3.0:1789427961.430831:0:6487:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff91968843ea00:6487] 0 exiting: rc = 1 00000100:00100000:0.0:1789427961.440252:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440269:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440275:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440308:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440315:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440322:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440329:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440470:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440480:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.440486:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443011:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443036:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443061:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443066:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443073:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443103:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443109:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443116:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443122:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443129:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443135:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443140:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443146:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443152:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443158:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443163:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443168:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443186:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443193:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443198:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443205:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443211:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443217:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443225:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443231:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443239:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443245:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443251:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443256:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443277:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443285:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443291:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443297:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443303:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443309:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443315:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443321:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443333:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443338:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443344:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443350:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443368:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443383:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443389:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443395:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443402:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443409:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443431:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443441:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443447:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443453:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443460:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443467:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.443473:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427961.480522:0:6489:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91968843e200:6489] 0 exiting: rc = 1 00000100:00100000:0.0:1789427961.481930:0:6490:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91968843fc00:6490] 1 exiting: rc = 0 00000100:00100000:1.0:1789427961.481991:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.481999:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482004:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482019:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482025:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482031:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482035:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482040:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482045:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482050:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482056:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482062:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482067:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482072:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482077:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482083:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482087:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482092:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482097:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482102:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482107:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482112:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482118:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482140:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482145:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482149:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482154:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482159:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482164:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482169:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482173:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482188:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482194:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482199:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482205:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482210:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482215:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482220:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482224:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482230:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482235:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482239:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482244:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482249:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482254:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482259:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482263:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482268:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482273:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482278:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482283:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482287:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482291:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482296:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482300:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482305:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482309:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482314:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482326:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482330:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482335:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482341:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482346:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427961.482350:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.488491:0:7440:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0002: service thread [ffff9196adbe5600:7440] 2 exiting: rc = 0 00000100:00100000:2.0:1789427961.488634:0:6492:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91968843e000:6492] 1 exiting: rc = 0 00000100:00100000:2.0:1789427961.489282:0:6491:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9196c198f600:6491] 0 exiting: rc = 1 00000100:00100000:0.0:1789427961.489474:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489481:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489485:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489490:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489503:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489509:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489514:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489518:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489523:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489528:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489533:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489538:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489543:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489548:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489553:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489557:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489561:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489583:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489588:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489603:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489609:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489613:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489618:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489623:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489628:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489633:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489638:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489643:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489648:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489652:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489658:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489663:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489667:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489982:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489990:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.489996:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490000:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490006:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490010:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490016:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490021:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490026:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490031:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490035:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490040:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490044:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490049:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490054:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490059:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490064:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490069:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490086:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490099:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490104:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490109:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490114:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490119:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490123:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490128:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490132:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490136:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490141:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490146:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.490152:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427961.491311:0:6493:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff91968843f800:6493] 0 exiting: rc = 1 00000100:00100000:0.0:1789427961.491564:0:8903:0:(service.c:3188:ptlrpc_main()) mdt_fld_0002: service thread [ffff9196bcc90400:8903] 2 exiting: rc = 0 00000100:00100000:0.0:1789427961.491650:0:6494:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff91968843e800:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1789427961.492194:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492202:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492207:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492212:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492216:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492221:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492227:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492231:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492236:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492242:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492248:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492253:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492258:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492262:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492267:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492272:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492276:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492281:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492285:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492289:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492293:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492297:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492313:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492318:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492322:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492327:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492331:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492337:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492440:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492446:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492450:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492455:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492460:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492466:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492471:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492476:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492481:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492485:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492490:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492506:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492511:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492516:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492521:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492525:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492530:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492535:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492540:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492545:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492550:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492555:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492559:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492564:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492569:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492573:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492577:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492581:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492585:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492608:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492612:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492617:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492621:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492625:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492630:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.492635:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.493952:0:6496:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9196888c4400:6496] 1 exiting: rc = 0 00000100:00100000:0.0:1789427961.494297:0:6495:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9196888c5a00:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1789427961.494867:0:6497:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9196888c4e00:6497] 2 exiting: rc = 0 00000100:00100000:2.0:1789427961.494929:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494951:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494957:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494963:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494968:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494972:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494978:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494984:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494989:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.494995:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495001:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495007:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495012:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495017:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495023:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495028:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495034:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495039:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495044:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495050:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495055:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495061:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495067:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.495072:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496068:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496874:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496897:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496902:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496907:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496913:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496918:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496924:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496930:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496936:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496942:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496948:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496954:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496961:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496968:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496974:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496978:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496984:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496989:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496994:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.496999:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497004:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497009:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497014:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497020:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497041:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497049:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497054:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497059:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497065:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497071:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497582:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497593:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497855:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497862:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497868:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497875:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497890:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497896:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427961.497902:0:15367:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789427961.515284:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427961.515298:0:15367:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789427961.515305:0:15367:0:(genops.c:885:class_export_put()) final put ffff919698502000/MDS_uuid 00000020:00000080:2.0:1789427961.515309:0:15367:0:(genops.c:844:class_export_destroy()) destroying export ffff919698502000/MDS_uuid for MDS 00000020:01000000:2.0:1789427961.515314:0:15367:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789427961.516944:0:15367:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789427962.224896:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427963.248632:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427964.210814:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789427964.210824:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789427964.210827:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789427964.210830:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789427964.210834:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427964.210842:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 303 00000100:00080000:2.0:1789427964.210848:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789427964.210861:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9196bbdd6000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427964.210898:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bed80 x1876350940118272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427964.210966:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789427964.210970:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789427964.210972:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427964.210975:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 303 00000100:00080000:2.0:1789427964.210978:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789427964.210982:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9196bca84800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789427964.210992:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bc380 x1876350940118528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427964.211098:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940118400:0@lo:400:kworker.0 00000400:00000100:0.0:1789427964.211154:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118400 offset 0 length 224: 4 00000100:00100000:0.0:1789427964.211219:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427964.211226:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940118656:0@lo:400:kworker.0 00000400:00000100:0.0:1789427964.211243:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118656 offset 0 length 224: 4 00000100:00100000:3.0:1789427964.211249:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940118272:0@lo:38:kworker.0 00000400:00000100:3.0:1789427964.211271:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118272 offset 0 length 520: 4 00000100:00100000:3.0:1789427964.211295:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940118528:0@lo:38:kworker.0 00000400:00000100:3.0:1789427964.211309:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118528 offset 0 length 520: 4 00010000:00010000:2.0:1789427964.274494:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427965.303614:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789427966.256885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427966.256894:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789427966.256898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427966.256901:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789427966.256964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427966.256969:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789427966.256996:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940118912:0@lo:400:kworker.0 00000400:00000100:1.0:1789427966.257046:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118912 offset 0 length 224: 4 00000100:00100000:1.0:1789427966.257094:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427966.257100:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940118784:0@lo:400:kworker.0 00000400:00000100:1.0:1789427966.257116:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940118784 offset 0 length 224: 4 00000001:00100000:3.0:1789427966.267620:0:8395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427966.267642:0:8395:0:(genops.c:885:class_export_put()) final put ffff9196bcc8f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427966.267667:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc8f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789427966.267710:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bcc8d000 for lustre-OST0000 00000001:00100000:3.0:1789427966.282312:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789427966.282321:0:9478:0:(genops.c:885:class_export_put()) final put ffff9196bca80800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789427966.285541:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca80800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789427966.285599:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca82000 for lustre-OST0001 00010000:00010000:3.0:1789427966.321047:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789427966.510613:0:15568:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789427966.547188:0:15568:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789427966.547240:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427966.547267:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427966.547291:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427966.547297:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427966.547356:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789427966.547364:0:15568:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789427966.547395:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789427966.547408:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bed80 x1876350940118272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427966.547450:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789427966.547456:0:15568:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789427966.547461:0:15568:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789427966.547467:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789427966.547470:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bed80 x1876350940118272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427966.547477:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789427966.547480:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 30s for inflight to error out 00000100:00100000:3.0:1789427966.548097:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940118272:0@lo:38:kworker.0 00000100:00080000:1.0:1789427966.556881:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789427966.556898:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bd880 x1876350940118400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427966.557000:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bf9f8e00 x1876350940118784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427966.557012:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789427966.557053:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940118784:0@lo:400:kworker.0 00000100:00080000:1.0:1789427966.557099:0:15568:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789427966.557122:0:15568:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789427966.558055:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427966.558066:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427966.558077:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427966.558082:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427966.558106:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427966.558113:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427966.558119:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427966.558122:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789427966.558124:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789427966.558140:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:0.0:1789427966.558144:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427966.558151:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208e00/0x84fc867ede51834e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518355 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427966.558164:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427966.558166:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427966.558167:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427966.558442:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940119040:0@lo:39:umount.0 00000400:00000100:3.0:1789427966.558491:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940119040 offset 0 length 224: 4 00000100:00100000:0.0:1789427966.559529:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940118400:0@lo:400:kworker.0 00010000:00010000:2.0:1789427967.344858:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427968.370837:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789427969.266453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789427969.266463:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789427969.266466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789427969.266485:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789427969.266668:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940119168:0@lo:400:kworker.0 00000400:00000100:0.0:1789427969.266726:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940119168 offset 0 length 224: 4 00010000:00010000:3.0:1789427969.392572:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427970.416728:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427970.672568:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427960/real 1789427960] req@ffff919583fc9500 x1876350940118144/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789427970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427970.672602:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff919583fc9500 x1876350940118144/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789427970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789427970.672625:0:3612:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789427970.672657:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789427970.672661:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940118144:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789427970.673091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789427970.673097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789427970.673100:0:37:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789427970.673105:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 305 00000100:00080000:0.0:1789427970.673126:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.124@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789427970.673137:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff91968382b000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789427970.673167:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fca680 x1876350940119296/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427970.673200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789427970.673204:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789427970.673267:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940119424:0@lo:400:kworker.0 00000400:00000100:1.0:1789427970.673325:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940119424 offset 0 length 224: 4 00000100:00100000:3.0:1789427970.673439:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940119296:0@lo:250:kworker.0 00000400:00000100:3.0:1789427970.673460:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940119296 offset 0 length 520: 4 00010000:00010000:2.0:1789427971.440651:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427972.464928:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427973.489748:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427974.513072:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427975.538838:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789427975.985893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427975.985903:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789427975.985906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789427975.985910:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789427975.986103:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427975.986124:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940119552:0@lo:400:kworker.0 00000400:00000100:3.0:1789427975.986187:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940119552 offset 0 length 224: 4 00010000:00010000:3.0:1789427976.560842:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427976.816561:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427966/real 1789427966] req@ffff9196bf9f8e00 x1876350940119040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789427976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427976.816594:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bf9f8e00 x1876350940119040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789427976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789427976.816613:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbdd2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789427976.816635:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940119040:0@lo:39:umount.0 00000100:00080000:1.0:1789427976.816788:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789427976.816793:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789427976.816797:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789427976.817853:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817869:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817877:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817883:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817910:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789427976.817919:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817942:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817948:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817955:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427976.817976:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789427976.817980:0:15568:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789427976.818007:0:15568:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789427976.818011:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789427976.818015:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427976.818021:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789427976.818025:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff919581ddcd40) has no exports 00000020:00080000:1.0:1789427976.818047:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff919581ddcd40) has no exports 00010000:00010000:0.0:1789427976.818091:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427976.818099:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818107:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427976.818111:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818120:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427976.818127:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427976.818133:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427976.818135:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789427976.818138:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789427976.818151:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:0.0:1789427976.818155:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818161:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208600/0x84fc867ede51835c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518363 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818182:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427976.818185:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818191:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427976.818194:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818201:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427976.818207:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427976.818212:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789427976.818214:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789427976.818216:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789427976.818220:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:0.0:1789427976.818223:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818229:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919699965800/0x84fc867ede5185c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5185cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427976.818251:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427976.818252:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427976.818254:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427976.819070:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789427976.821611:0:15568:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91958335c360 - data ffff9196a9f11438/ffff91958359f800 00000020:01000000:1.0:1789427976.821774:0:15568:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9196b6382a20 - data ffff9196a9dc2af8/ffff9196bcb8dc00 00100000:10000000:1.0:1789427976.849284:0:15568:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789427976.868652:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5180a0 00000020:00000080:0.0:1789427976.868667:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196bc9ea000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789427976.868700:0:15568:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bc9e1800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789427976.869962:0:15568:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bc9e1800 2 00000020:01000004:0.0:1789427976.869969:0:15568:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196bc9e1800 from lustre-OST0000 00000020:00000080:0.0:1789427976.869997:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427976.870008:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789427976.870012:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196bc9ed800/lustre-OST0000_UUID 00000020:00000080:0.0:1789427976.870015:0:15568:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9ed800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789427976.870022:0:15568:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789427976.870082:0:15568:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789427976.870086:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789427976.870090:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427976.870095:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427976.870101:0:15568:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9196b7088800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427976.870107:0:15568:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9196bbde0000) has exports, disconnecting them 00000020:00080000:0.0:1789427976.870112:0:15568:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9196b7088800), last request at 1789427745 00000020:00000080:0.0:1789427976.870117:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5180ca 00000020:00080000:0.0:1789427976.870131:0:15568:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196b7088800): rc 0 00000020:00000080:0.0:1789427976.870136:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196b7088800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789427976.872200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bc9ea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789427976.872224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b7088800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789427976.882588:0:15568:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789427976.882599:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427976.882604:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789427976.882613:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789427976.882815:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427976.882824:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789427976.882830:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789427976.882837:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427976.882842:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789427976.882850:0:15568:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9196b708b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427976.882858:0:15568:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9196bbde4d40) has exports, disconnecting them 00000020:00080000:2.0:1789427976.882862:0:15568:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9196b708b800), last request at 1789427745 00000020:00000080:2.0:1789427976.882867:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5180df 00000020:00080000:2.0:1789427976.882882:0:15568:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196b708b800): rc 0 00000020:00000080:2.0:1789427976.882887:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196b708b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789427976.883399:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbdd6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789427976.883409:0:8:0:(genops.c:885:class_export_put()) final put ffff9196b708f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789427976.883428:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b708f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789427976.883440:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789427976.883506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b708b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789427976.885797:0:15568:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789427976.885804:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789427976.885808:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789427976.885815:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789427976.885842:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbdd2000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789427976.886032:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789427976.886041:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789427976.886045:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196b708e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789427976.886049:0:15568:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b708e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789427976.886054:0:15568:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789427976.886109:0:15568:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bc9e1800 1 00000020:00000080:3.0:1789427976.886114:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518068 00000020:00000080:3.0:1789427976.886120:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196905ae000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789427976.886128:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789427976.886136:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789427976.886146:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789427976.886151:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789427976.886154:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9196bcb419c0) has no exports 00000020:00000080:2.0:1789427977.101497:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427977.101512:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789427977.101519:0:15568:0:(genops.c:885:class_export_put()) final put ffff9196a9811000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789427977.101524:0:15568:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a9811000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789427977.101538:0:15568:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789427977.101671:0:15568:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91968382f800 00000020:02000400:2.0:1789427977.101718:0:15568:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789427977.584584:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427978.608540:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427979.632644:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789427980.510138:0:15770:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789427980.521662:0:15770:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789427980.521920:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427980.521956:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427980.521963:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427980.521969:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427980.522026:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789427980.522031:0:15770:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789427980.522057:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789427980.522069:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bc380 x1876350940118528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.522091:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789427980.522097:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789427980.522103:0:15770:0:(import.c:65:import_set_state_nolock()) ffff9196bca84800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789427980.522107:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789427980.522111:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bc380 x1876350940118528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.522117:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789427980.522120:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:0.0:1789427980.522308:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940118528:0@lo:38:kworker.0 00000100:00080000:3.0:1789427980.523457:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789427980.523466:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9195831bc000 x1876350940118656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.523484:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bf9fb800 x1876350940118912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.523514:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196ad92a300 x1876350940119168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.523522:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff919583fc9f80 x1876350940119424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.523534:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bf9f8700 x1876350940119552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427980.523540:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789427980.523545:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789427980.523563:0:15770:0:(import.c:65:import_set_state_nolock()) ffff9196bca83000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789427980.523716:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940119168:0@lo:400:kworker.0 00000100:00100000:0.0:1789427980.523725:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940118656:0@lo:400:kworker.0 00000100:00100000:0.0:1789427980.523760:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940119680:0@lo:39:umount.0 00000400:00000100:0.0:1789427980.523805:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940119680 offset 0 length 224: 4 00010000:00010000:1.0:1789427980.524092:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427980.524100:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427980.524109:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789427980.524113:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427980.524221:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427980.524237:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427980.524243:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427980.524245:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789427980.524248:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789427980.524260:0:6472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:1.0:1789427980.524264:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427980.524272:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede518332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518339 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427980.524283:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427980.524285:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427980.524286:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427980.524304:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940119552:0@lo:400:kworker.0 00000100:00100000:1.0:1789427980.524311:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940118912:0@lo:400:kworker.0 00000100:00100000:1.0:1789427980.524332:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940119424:0@lo:400:kworker.0 00010000:00010000:2.0:1789427980.656714:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427981.108131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789427981.108141:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789427981.680592:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427982.705053:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427983.729040:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427984.752741:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427985.648599:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427970/real 1789427970] req@ffff919583fca680 x1876350940119296/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789427985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427985.648640:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff919583fca680 x1876350940119296/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789427985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789427985.648656:0:3612:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789427985.648678:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789427985.648682:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940119296:0@lo:250:kworker.0 00000100:00080000:3.0:1789427985.650337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789427985.650347:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789427985.650351:0:37:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789427985.650359:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 315 00000100:00080000:3.0:1789427985.650365:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.124@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789427985.650378:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff91968382b000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789427985.650458:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196ad928380 x1876350940119808/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427985.650827:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940119808:0@lo:250:kworker.0 00000400:00000100:0.0:1789427985.650897:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940119808 offset 0 length 520: 4 00010000:00010000:3.0:1789427985.777242:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427986.801033:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427987.825380:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427988.849037:0:9487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427989.872576:0:7424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427990.768541:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427980/real 1789427980] req@ffff9196ad929500 x1876350940119680/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789427990 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427990.768567:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196ad929500 x1876350940119680/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789427990 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789427990.768582:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca83000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789427990.768593:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940119680:0@lo:39:umount.0 00000100:00080000:3.0:1789427990.768622:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789427990.768627:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789427990.768632:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789427990.769831:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769863:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769871:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769878:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769903:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427990.769911:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769918:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769925:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769932:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427990.769949:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789427990.769954:0:15770:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1789427990.769967:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427990.769972:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789427990.769978:0:15770:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1789427990.769979:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91968883a000 already unused, calling callback (ffffffffc118ec20) 00000020:01000000:3.0:1789427990.769981:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:0.0:1789427990.769982:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789427990.769986:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1789427990.769990:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789427990.769991:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789427990.769996:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff919583028000) has no exports 10000000:00010000:0.0:1789427990.770007:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427990.770012:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427990.770014:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789427990.770016:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:3.0:1789427990.770021:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff919583028000) has no exports 00010000:00010000:0.0:1789427990.770028:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:0.0:1789427990.770031:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770038:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91968883a000/0x84fc867ede518340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede518347 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770051:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427990.770054:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770060:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ec00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789427990.770063:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770069:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427990.770076:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427990.770081:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789427990.770083:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789427990.770088:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789427990.770094:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:0.0:1789427990.770097:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770114:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1ec00/0x84fc867ede5185b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5185bd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427990.770127:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427990.770128:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427990.770130:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427990.770179:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789427990.772211:0:15770:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195830208a0 - data ffff9196a9ce1000/ffff91958372a400 00000020:01000000:3.0:1789427990.772339:0:15770:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195835decc0 - data ffff91958200fe58/ffff91958359c800 00100000:10000000:3.0:1789427990.781340:0:15770:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789427990.791430:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5181c6 00000020:00000080:2.0:1789427990.791443:0:15770:0:(genops.c:885:class_export_put()) final put ffff919583037800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789427990.791457:0:15770:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bcc8a000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789427990.791461:0:15770:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8a000 2 00000020:01000004:2.0:1789427990.791464:0:15770:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196bcc8a000 from lustre-OST0001 00000020:00000080:2.0:1789427990.791492:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427990.791501:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789427990.791505:0:15770:0:(genops.c:885:class_export_put()) final put ffff919583035800/lustre-OST0001_UUID 00000020:00000080:2.0:1789427990.791508:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff919583035800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789427990.791514:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789427990.791661:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6->MGS 00010000:00010000:2.0:1789427990.791678:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919699965400/0x84fc867ede517f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427990.791690:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919699965400/0x84fc867ede517f1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427990.791696:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789427990.791699:0:15770:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789427990.791702:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789427990.791713:0:15770:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:2.0:1789427990.791717:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919699965400/0x84fc867ede517f1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede517f26 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427990.791731:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789427990.792075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583037800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:2.0:1789427990.793128:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427990.793133:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789427990.793137:0:15770:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789427990.793139:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789427990.793155:0:15770:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91968382b000 00010000:00010000:2.0:1789427990.793158:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209e00/0x84fc867ede5183a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5183a9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789427990.793186:0:15770:0:(import.c:65:import_set_state_nolock()) ffff91968382b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789427990.793192:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789427990.793194:0:15770:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789427990.793196:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789427990.793201:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789427990.793212:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196ad928380 x1876350940119808/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789428005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789427990.793243:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789427990.793246:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789427990.793309:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:180a49e9-dc77-4e16-a3c4-7cb28e3c80a6:3612:1876350940119808:0@lo:250:kworker.0 10000000:01000000:2.0:1789427990.793837:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789427990.793845:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede517e1c 00000020:00000080:2.0:1789427990.793851:0:15770:0:(genops.c:885:class_export_put()) final put ffff919698500800/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 00000020:01000000:2.0:1789427990.793868:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.124@tcp (flags='') 00000020:00000080:2.0:1789427990.793874:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427990.793879:0:15770:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789427990.793883:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff919688454d40) has no exports 00000020:00000080:1.0:1789427990.793913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919698500800/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 for MGC192.168.202.124@tcp 10000000:01000000:0.0:1789427990.799158:0:6481:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789427990.799274:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.124@tcp: client import never connected 00000100:00080000:2.0:1789427990.799279:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789427990.799335:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789427990.799340:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789427990.799476:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789427990.799531:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427990.799537:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91968382b000 for MGC192.168.202.124@tcp 00000020:00000080:2.0:1789427990.799541:0:15770:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.124@tcp (uuid 180a49e9-dc77-4e16-a3c4-7cb28e3c80a6) 00000020:00000080:1.0:1789427990.799549:0:8:0:(genops.c:885:class_export_put()) final put ffff91968382e000/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 00000020:01000000:2.0:1789427990.799551:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789427990.799555:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427990.799559:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91968382e000/180a49e9-dc77-4e16-a3c4-7cb28e3c80a6 for MGC192.168.202.124@tcp 00000020:00000080:2.0:1789427990.799561:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:01000000:1.0:1789427990.799566:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.124@tcp (180a49e9-dc77-4e16-a3c4-7cb28e3c80a6) 00000020:00080000:2.0:1789427990.799571:0:15770:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff919582437800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427990.799578:0:15770:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9196bf98cd40) has exports, disconnecting them 00000020:00080000:2.0:1789427990.799582:0:15770:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff919582437800), last request at 1789427755 00000020:00000080:2.0:1789427990.799587:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5181f0 00000020:00080000:2.0:1789427990.799602:0:15770:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582437800): rc 0 00000020:00000080:2.0:1789427990.799606:0:15770:0:(genops.c:885:class_export_put()) final put ffff919582437800/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789427990.801023:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789427990.801029:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427990.801033:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789427990.801039:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789427990.801204:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427990.801210:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789427990.801215:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789427990.801219:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427990.801223:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427990.801228:0:15770:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9196bca87000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427990.801234:0:15770:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9196bf9899c0) has exports, disconnecting them 00000020:00080000:0.0:1789427990.801237:0:15770:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9196bca87000), last request at 1789427755 00000020:00000080:0.0:1789427990.801241:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518205 00000020:00080000:0.0:1789427990.801252:0:15770:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196bca87000): rc 0 00000020:00000080:0.0:1789427990.801256:0:15770:0:(genops.c:885:class_export_put()) final put ffff9196bca87000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789427990.801599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919582437800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789427990.801608:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca84800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789427990.801612:0:8:0:(genops.c:885:class_export_put()) final put ffff9196bca86800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789427990.801614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca86800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789427990.801618:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789427990.801660:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca87000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789427990.817761:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789427990.817770:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789427990.817774:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789427990.817782:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427990.817813:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca83000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789427990.818670:0:9487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789427990.821690:0:7424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789427990.823487:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789427990.823585:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789427990.823700:0:6512:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9196c1a71600:6512] 2 exiting: rc = 0 00000100:00100000:1.0:1789427990.825499:0:6466:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91968370c800:6466] 0 exiting: rc = 1 00000100:00100000:3.0:1789427990.827493:0:6467:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9196b8a3ec00:6467] 1 exiting: rc = 0 00000100:00100000:1.0:1789427990.827635:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.828216:0:7887:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9196b62f5400:7887] 4 exiting: rc = 0 00000100:00100000:0.0:1789427990.828464:0:6470:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9196b8a3ea00:6470] 2 exiting: rc = 0 00000100:00100000:0.0:1789427990.828543:0:6513:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9196ada2d000:6513] 3 exiting: rc = 0 00000100:00100000:3.0:1789427990.829288:0:6469:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9196b8a3f400:6469] 1 exiting: rc = 0 00000100:00100000:3.0:1789427990.829366:0:6468:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9196b8a3fc00:6468] 0 exiting: rc = 1 00000100:00100000:1.0:1789427990.834445:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834456:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834462:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834469:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834474:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834480:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834485:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834491:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834497:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834502:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834507:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834513:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834530:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834537:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834543:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834548:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834553:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834560:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834566:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834571:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834576:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834581:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834586:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834592:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834596:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834601:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834606:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834611:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834683:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834691:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834696:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834700:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834705:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834710:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834716:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834721:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834725:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834730:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834801:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834810:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834881:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834889:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834894:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834900:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834905:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834911:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834916:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834930:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834935:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834941:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834946:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834951:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834957:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834961:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834966:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834972:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834977:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834982:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834987:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834992:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.834997:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.835001:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.835007:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.835012:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789427990.836170:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427990.836180:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789427990.836187:0:15770:0:(genops.c:885:class_export_put()) final put ffff9196bca82800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789427990.836192:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca82800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789427990.836197:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789427990.836244:0:15770:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8a000 1 00000020:00000080:1.0:1789427990.836251:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede518195 00000020:00000080:1.0:1789427990.836257:0:15770:0:(genops.c:885:class_export_put()) final put ffff9196a05a5000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789427990.836274:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789427990.836278:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427990.836283:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789427990.836287:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff91958302b380) has no exports 00000020:00000080:3.0:1789427990.840079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a05a5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789427990.866399:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427990.866432:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789427990.866439:0:15770:0:(genops.c:885:class_export_put()) final put ffff919583035000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789427990.866444:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff919583035000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789427990.866467:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789427990.866825:0:15770:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9196bcc8c800 00000020:01000000:1.0:1789427990.866849:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789427990.866853:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427990.866858:0:15770:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789427990.866862:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9196bbde3380) has no exports 00000020:00000080:1.0:1789427990.866892:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427990.866898:0:15770:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789427990.866901:0:15770:0:(genops.c:885:class_export_put()) final put ffff9196905ab000/OSS_uuid 00000020:00000080:1.0:1789427990.866903:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ab000/OSS_uuid for OSS 00000020:01000000:1.0:1789427990.866907:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789427990.867068:0:8902:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff91958242e600:8902] 3 exiting: rc = 0 00000100:00100000:1.0:1789427990.867183:0:13777:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff91969ad7b600:13777] 4 exiting: rc = 0 00000100:00100000:3.0:1789427990.867846:0:8400:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9196bc969800:8400] 0 exiting: rc = 1 00000100:00100000:3.0:1789427990.867917:0:8401:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9196ad90c400:8401] 1 exiting: rc = 0 00000100:00100000:3.0:1789427990.867970:0:8402:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9196bbd6d000:8402] 2 exiting: rc = 0 00000100:00100000:2.0:1789427990.868057:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868077:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868087:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868094:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868113:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868120:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868127:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868132:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868138:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868143:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868148:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868154:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868160:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868166:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868171:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868176:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868182:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868187:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868208:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868215:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868289:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868296:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868302:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868308:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868314:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868319:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868324:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868330:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868335:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868340:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868435:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868442:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868447:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868452:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868457:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868463:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868471:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868478:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868483:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868489:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868494:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868499:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868504:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868509:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868516:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868524:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868530:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868538:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868546:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868551:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868555:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868560:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868573:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868577:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868582:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868587:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868593:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868598:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868603:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868608:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868613:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868692:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.868706:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.869995:0:8404:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9196b62f4400:8404] 1 exiting: rc = 0 00000100:00100000:1.0:1789427990.870078:0:8403:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9196bbd69400:8403] 0 exiting: rc = 1 00000100:00100000:2.0:1789427990.870486:0:10314:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9195837fcc00:10314] 2 exiting: rc = 0 00000100:00100000:1.0:1789427990.870596:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.870603:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.870609:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.870614:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1789427990.871262:0:6479:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789427990.871779:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.871784:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.871789:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.871795:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.871800:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.871805:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872250:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872259:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872265:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872270:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872275:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872281:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872286:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872291:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872309:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872315:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872320:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872325:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872330:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872335:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872341:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872363:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872368:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872373:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872378:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872383:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872388:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872393:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872398:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872403:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872408:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872449:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872456:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872462:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872467:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872472:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872477:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872482:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872487:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872492:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872496:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872501:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872507:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872512:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872517:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872523:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872527:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872532:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872545:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872550:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872556:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872563:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872569:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872574:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872666:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872672:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872677:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872682:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.872687:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427990.874002:0:8406:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9196b62f6000:8406] 1 exiting: rc = 0 00000100:00100000:2.0:1789427990.874201:0:8405:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9196b62f7a00:8405] 0 exiting: rc = 1 00000100:00100000:2.0:1789427990.874366:0:8407:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9196b62f6e00:8407] 2 exiting: rc = 0 00000100:00100000:1.0:1789427990.874582:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874590:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874596:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874601:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874607:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874613:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874630:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874636:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874642:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874646:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874652:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874657:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874662:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874667:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874672:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874678:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874683:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874689:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874694:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874699:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874704:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874709:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874714:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874736:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874897:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874906:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874912:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874917:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874922:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874927:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874933:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874939:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874944:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874951:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874956:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874962:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874967:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874974:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874979:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874985:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874991:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.874998:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875004:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875010:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875016:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875022:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875027:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875049:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875058:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875063:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875068:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875074:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875079:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875085:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875091:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875121:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875132:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875141:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875149:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875171:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875177:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875182:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875187:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427990.875193:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.886036:0:8408:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9196b62f7200:8408] 0 exiting: rc = 1 00000100:00100000:2.0:1789427990.886195:0:8905:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff91958242c400:8905] 2 exiting: rc = 0 00000100:00100000:3.0:1789427990.886621:0:8409:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff919687c43c00:8409] 1 exiting: rc = 0 00000100:00100000:0.0:1789427990.892363:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892374:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892381:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892386:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892392:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892398:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892404:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892410:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892431:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892437:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892443:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892450:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892455:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892473:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892480:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892486:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892492:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892498:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892503:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892508:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892513:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892518:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892523:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892530:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892535:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892540:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892545:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892550:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892555:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892561:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892566:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892572:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892592:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892598:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892603:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892608:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892613:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892619:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892624:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892629:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892634:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892639:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892645:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892650:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892654:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892660:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892665:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892670:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892675:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892680:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892686:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892691:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892697:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892702:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892708:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892713:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892718:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892724:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892729:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892734:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892740:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892745:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892757:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.892765:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893662:0:8410:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9196a0a75600:8410] 0 exiting: rc = 1 00000100:00100000:0.0:1789427990.893769:0:8411:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9196a0a74600:8411] 1 exiting: rc = 0 00000100:00100000:0.0:1789427990.893824:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893857:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893865:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893871:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893878:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893884:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893891:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893897:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893904:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893911:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893917:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893923:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893930:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893954:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893963:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893970:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893978:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893985:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.893991:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894000:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894007:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894013:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894021:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894027:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894032:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894058:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894066:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894073:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894080:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894085:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894091:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894096:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894115:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894123:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894129:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894136:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.894152:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896308:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896324:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896331:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896337:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896345:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896352:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896358:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896365:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896371:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896377:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896383:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896389:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896408:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896430:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896436:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896444:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896451:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896458:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896464:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896471:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896477:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896483:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896490:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896496:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896503:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896510:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427990.896525:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789427990.911781:0:15770:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789428006.182843:0:16535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789428013.728024:0:17138:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789428013.728030:0:17138:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789428013.728032:0:17138:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789428013.728151:0:17138:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196bfad4800 00000020:01000004:3.0:1789428013.728168:0:17138:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789428013.728175:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789428013.728189:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9196bf98b380) 00000020:00000080:3.0:1789428013.728202:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789428013.771073:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789428013.771635:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.778636:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.780205:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.780704:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.781007:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.781191:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.781375:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.781679:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.781986:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.782216:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.782435:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.782641:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.782904:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789428013.783173:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789428013.783654:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.783931:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.784167:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.784345:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.784594:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.784817:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.785126:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.785319:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.785593:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.785767:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.786069:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.786251:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.786593:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.786802:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.787101:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.787313:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.787644:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.787879:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.788120:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.788316:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.788609:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.788783:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.789101:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.789287:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.789527:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.789736:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.790231:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789428013.794090:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.794621:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.794950:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.795200:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789428013.795439:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789428013.797153:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789428013.797477:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789428013.797700:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789428013.798174:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789428013.798360:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789428013.798595:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789428013.799320:0:17138:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789428013.799556:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789428013.799564:0:17138:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789428013.799576:0:17138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede5193cb 00000020:01000004:2.0:1789428013.799583:0:17138:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789428013.799588:0:17138:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789428013.799593:0:17138:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bfad4800 from MGS 00000020:01000004:2.0:1789428013.799596:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789428013.799612:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff919581dd99c0) 00000020:00000080:2.0:1789428013.799641:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789428013.799714:0:17138:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bfad4800 from MGS, refs=2 00080000:01000000:2.0:1789428013.799719:0:17138:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789428013.799723:0:17138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede5193d9 00000100:00100000:2.0:1789428013.799816:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789428013.800191:0:17138:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789428013.800196:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789428013.800667:0:17138:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789428013.800673:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789428013.801363:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428013.801573:0:17138:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789428013.801578:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789428013.802139:0:17138:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789428013.802146:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789428013.802669:0:17138:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789428013.802677:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789428013.803352:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428013.803355:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428013.803357:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428013.803777:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428013.803779:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428013.803781:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428013.804387:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1789428013.809643:0:17138:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:1.0:1789428013.809915:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789428013.810581:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789428013.810626:0:17138:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789428013.810663:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789428013.811473:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789428013.811765:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789428013.812376:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789428013.812383:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789428013.818935:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789428013.818963:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789428013.819296:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789428013.819303:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789428013.820375:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789428013.820396:0:17138:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.124@tcp' 00000020:01000004:1.0:1789428013.820398:0:17138:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789428013.820461:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.124@tcp (typ=mgc) 00000020:00000080:1.0:1789428013.820473:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.124@tcp (ffff91958302b380) 00000020:00000080:1.0:1789428013.820488:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789428013.820564:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919584424000@MGC192.168.202.124@tcp: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789428013.820708:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.124@tcp-0 is initialized 00000040:01000000:1.0:1789428013.820714:0:17138:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789428013.822114:0:17155:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789428013.822680:0:17156:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789428013.822760:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.124@tcp (uuid 6c098993-d5b4-48be-b0c2-bdb904c28b81) 00000020:00000080:0.0:1789428013.822790:0:17138:0:(genops.c:1384:class_connect()) connect: client 6c098993-d5b4-48be-b0c2-bdb904c28b81, cookie 0x84fc867ede5193e7 00000100:00080000:0.0:1789428013.822802:0:17138:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428013.822813:0:17138:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff919584424000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428013.822921:0:17138:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fca680 x1876350940119936/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428013.822944:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS 00000020:01000004:0.0:1789428013.824013:0:17138:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789428013.824029:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789428013.824041:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9196bcb43380) 00000020:00000080:0.0:1789428013.824055:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789428013.837865:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428013.843525:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940119936:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789428013.843593:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428013.843710:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940119936 00000100:00100000:3.0:1789428013.843718:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940119936 00000100:00100000:3.0:1789428013.843749:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428013.843757:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3612:x1876350940119936:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789428013.843787:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6c098993-d5b4-48be-b0c2-bdb904c28b81@0@lo t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1789428013.843813:0:17151:0:(genops.c:1384:class_connect()) connect: client 6c098993-d5b4-48be-b0c2-bdb904c28b81, cookie 0x84fc867ede5193f5 00000100:00100000:0.0:1789428013.843858:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789428013.843865:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00080000:3.0:1789428013.843936:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9196bfad1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428013.844083:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+5:3612:x1876350940119936:12345-0@lo:250:mount.lustre.0 Request processed in 324us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428013.844090:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428013.844141:0:3612:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789428013.844149:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.124@tcp: connect to target with instance 0 00000100:00080000:3.0:1789428013.844157:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789428013.844162:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789428013.844165:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789428013.844167:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789428013.844175:0:3612:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789428013.844179:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940119936:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789428013.845030:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789428013.845038:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789428013.845806:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789428013.845812:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789428013.846623:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789428013.846764:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789428013.846768:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789428013.847224:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789428013.847229:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789428013.880727:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428013.880956:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789428013.880962:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789428013.882227:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789428013.882236:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789428013.882985:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789428013.883329:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789428013.883334:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789428013.883909:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789428013.883917:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789428013.885591:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789428013.885741:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789428013.885747:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789428013.886650:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789428013.886659:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789428013.887406:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789428013.887759:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789428013.887765:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789428013.888903:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789428013.888913:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789428013.910018:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789428013.910653:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789428013.910660:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789428013.913579:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789428013.913591:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789428013.914614:0:17138:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789428013.914622:0:17138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789428013.920202:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789428013.920235:0:17138:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789428013.920241:0:17138:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789428013.920355:0:17138:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789428013.920388:0:17138:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789428013.920393:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789428013.920395:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789428013.920397:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428013.920398:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428013.920400:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428013.920401:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428013.920403:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428013.920404:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789428013.920406:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428013.920407:0:17138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789428013.920410:0:17138:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789428013.921229:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789428013.921233:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789428013.921235:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428013.921236:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428013.921237:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428013.921239:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428013.921248:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428013.921250:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789428013.921251:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428013.921252:0:17138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789428013.921278:0:17138:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789428013.921298:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120064:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789428013.921368:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.921484:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428013.921658:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120064 00000100:00100000:2.0:1789428013.921667:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120064 00000100:00100000:2.0:1789428013.921768:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428013.921779:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+5:17138:x1876350940120064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789428013.921841:0:17153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789428013.921844:0:17153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789428013.921847:0:17153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789428013.922574:0:17175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789428013.923034:0:17153:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789428013.924581:0:17176:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789428013.924589:0:17176:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789428013.924592:0:17176:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789428013.924595:0:17176:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789428013.924760:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789428013.925027:0:17153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789428013.925039:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789428013.927104:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+5:17138:x1876350940120064:12345-0@lo:253:mount.lustre.0 Request processed in 5319us (5728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428013.927127:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428013.927288:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120064:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789428013.927303:0:17138:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789428013.927306:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789428013.927308:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789428013.927309:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428013.927311:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428013.927312:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428013.927314:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428013.927315:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428013.927317:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789428013.927319:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428013.927321:0:17138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789428013.927341:0:17138:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bfad4800 from lustre-MDT0000 10000000:01000000:1.0:1789428013.927369:0:17138:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789428013.927372:0:17138:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789428013.927375:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91958302b380 10000000:01000000:1.0:1789428013.927378:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789428013.927384:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91958302b380 from 1 10000000:01000000:1.0:1789428013.927386:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789428013.927439:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.927448:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.927455:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428013.927476:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789428013.927502:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.927534:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428013.927548:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120192 00000100:00100000:3.0:1789428013.927555:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120192 00000100:00100000:3.0:1789428013.927592:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428013.927600:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+5:17138:x1876350940120192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428013.927612:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428013.927626:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ec000/0x84fc867ede519403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5193fc expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428013.927649:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ec000/0x84fc867ede519403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5193fc expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428013.927660:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ec000/0x84fc867ede519403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5193fc expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428013.927679:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec000, rc 0) 00000100:00100000:3.0:1789428013.927718:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+6:17138:x1876350940120192:12345-0@lo:101:mount.lustre.0 Request processed in 119us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428013.927724:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428013.927779:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428013.927789:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.927795:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428013.927851:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428013.927868:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.927885:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428013.927958:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120320 00000100:00100000:2.0:1789428013.927963:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120320 00000100:00100000:2.0:1789428013.927991:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428013.927999:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+6:17138:x1876350940120320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428013.928064:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+6:17138:x1876350940120320:12345-0@lo:501:mount.lustre.0 Request processed in 66us (193us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789428013.928070:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428013.928092:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789428013.928183:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789428013.928202:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928211:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428013.928218:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196bfad4800 10000000:01000000:1.0:1789428013.928222:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789428013.928226:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9196bfad4800 10000000:01000000:1.0:1789428013.928228:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789428013.928231:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9196bfad4800 from 1 10000000:01000000:1.0:1789428013.928238:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789428013.928252:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928259:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928266:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428013.928276:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789428013.928301:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.928364:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428013.928509:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120448 00000100:00100000:2.0:1789428013.928514:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120448 00000100:00100000:2.0:1789428013.928567:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428013.928574:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+6:17138:x1876350940120448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428013.928581:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428013.928594:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375ca00/0x84fc867ede519411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51940a expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428013.928608:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375ca00/0x84fc867ede519411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51940a expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428013.928616:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375ca00/0x84fc867ede519411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51940a expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428013.928623:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375ca00, rc 0) 00000100:00100000:2.0:1789428013.928660:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+7:17138:x1876350940120448:12345-0@lo:101:mount.lustre.0 Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428013.928666:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789428013.928735:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428013.928746:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928754:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428013.928764:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789428013.928778:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928786:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428013.928793:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789428013.928797:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789428013.928817:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9196bfad4800 10000000:01000000:1.0:1789428013.928819:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789428013.928823:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789428013.928825:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789428013.928840:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928847:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.928855:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428013.928866:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789428013.928902:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.929064:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789428013.929131:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120576 00000100:00100000:0.0:1789428013.929136:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120576 00000100:00100000:0.0:1789428013.929160:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428013.929167:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+7:17138:x1876350940120576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428013.929174:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428013.929186:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e600/0x84fc867ede51941f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519418 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428013.929214:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e600/0x84fc867ede51941f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519418 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428013.929222:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e600/0x84fc867ede51941f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519418 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428013.929229:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e600, rc 0) 00000100:00100000:0.0:1789428013.929265:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+8:17138:x1876350940120576:12345-0@lo:101:mount.lustre.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428013.929271:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428013.929403:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428013.929438:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428013.929447:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428013.929493:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428013.929517:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.929533:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789428013.933168:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120704 00000100:00100000:0.0:1789428013.933185:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120704 00000100:00100000:0.0:1789428013.933238:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428013.933249:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+8:17138:x1876350940120704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428013.933458:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17138:x1876350940120704:12345-0@lo:501:mount.lustre.0 Request processed in 210us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428013.933467:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428013.933787:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428013.933916:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428013.933978:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428013.934017:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789428013.934070:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120832 00000100:00100000:0.0:1789428013.934075:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120832 00000100:00100000:0.0:1789428013.934193:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428013.934202:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17138:x1876350940120832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428013.934864:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17138:x1876350940120832:12345-0@lo:503:mount.lustre.0 Request processed in 662us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428013.934872:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428013.934954:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940120832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428013.935860:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17177:1876350940120960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428013.935921:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428013.935990:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428013.936027:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940120960 00000100:00100000:2.0:1789428013.936033:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940120960 00000100:00100000:2.0:1789428013.936108:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428013.936118:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17177:x1876350940120960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428013.936624:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17177:x1876350940120960:12345-0@lo:502:llog_process_th.0 Request processed in 507us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428013.936632:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428013.936716:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17177:1876350940120960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789428013.936740:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428013.936751:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428013.936754:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789428013.936759:0:17177:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789428013.936761:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428013.936775:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9196bf9899c0) 00000020:00000080:3.0:1789428013.936792:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789428013.936798:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789428013.936969:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789428013.936976:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede51942d 00000020:00000080:3.0:1789428013.937250:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789428013.937255:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428013.937259:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428013.937260:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789428013.937263:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428013.937267:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428013.937268:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789428013.937271:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428013.937278:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9196bf98cd40) 00000020:00000080:3.0:1789428013.937288:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789428013.937299:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789428013.937301:0:17177:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789428013.937304:0:17177:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789428013.937310:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789428013.937355:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bfad4800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789428013.937368:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9196bf988000) 00000020:00000080:3.0:1789428013.937376:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789428013.937563:0:17177:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789428013.937570:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519442 00000020:00000080:3.0:1789428013.937663:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789428013.937669:0:17177:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789428013.937673:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x84fc867ede519449 00080000:01000000:3.0:1789428013.937678:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789428013.937681:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519450 00010000:00010000:1.0:1789428014.007378:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789428014.008166:0:17177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789428014.008484:0:17177:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789428014.009115:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff919583028000) 00000020:00000080:1.0:1789428014.009133:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789428014.009219:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789428014.009227:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede51945e 00000020:00000080:1.0:1789428014.010365:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789428014.013923:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x84fc867ede519465 00000020:00000080:1.0:1789428014.014444:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789428014.014458:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428014.014464:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.014466:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789428014.014469:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789428014.014471:0:17177:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789428014.014473:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789428014.014474:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789428014.014476:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789428014.014478:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.014480:0:17177:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789428014.014482:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428014.014487:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.014488:0:17177:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789428014.014493:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789428014.014530:0:17177:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789428014.014547:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428014.014550:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.014551:0:17177:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789428014.014559:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428014.014562:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.014564:0:17177:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789428014.014566:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789428014.014572:0:17177:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:1.0:1789428014.014609:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789428014.014624:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff91958302cd40) 00000020:00000080:1.0:1789428014.014638:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789428014.014643:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789428014.014699:0:17177:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789428014.014705:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789428014.014710:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519473 00010000:00080000:1.0:1789428014.014749:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196905eb000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789428014.019019:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789428014.020797:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789428014.020936:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789428014.021044:0:17177:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789428014.021066:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede51947a 00000100:00080000:2.0:1789428014.021076:0:17177:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428014.021089:0:17177:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196905eb000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428014.021191:0:17177:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bea00 x1876350940121088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428014.021275:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789428014.021345:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428014.021484:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121088 00000100:00100000:1.0:1789428014.021492:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121088 00000100:00100000:1.0:1789428014.021525:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428014.021533:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940121088:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789428014.021547:0:17164:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789428014.022013:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789428014.022097:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428014.022103:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.022105:0:17177:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789428014.022108:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789428014.022110:0:17177:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1789428014.022112:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428014.022114:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428014.022115:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428014.022118:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.022119:0:17177:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428014.022122:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789428014.022127:0:17177:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789428014.022130:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.022132:0:17177:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789428014.022142:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789428014.022146:0:17177:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1789428014.022168:0:17177:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789428014.022171:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428014.022184:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff919581ddb380) 00000020:00000080:2.0:1789428014.022198:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789428014.022203:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789428014.022266:0:17177:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789428014.022274:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789428014.022280:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519488 00010000:00080000:2.0:1789428014.022306:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196ad917000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428014.022529:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789428014.029083:0:17177:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789428014.029372:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789428014.035781:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428014.036178:0:17177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789428014.042603:0:17177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789428014.046273:0:17183:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789428014.046283:0:17183:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789428014.048313:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789428014.048327:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428014.048364:0:17177:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789428014.048384:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede51948f 00000100:00080000:2.0:1789428014.048394:0:17177:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428014.048407:0:17177:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9196ad917000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428014.048474:0:17177:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bf100 x1876350940121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428014.048500:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789428014.048568:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428014.048573:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.048575:0:17177:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789428014.048578:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789428014.048581:0:17177:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789428014.048588:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428014.048590:0:17177:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428014.048592:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428014.048594:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.048596:0:17177:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428014.048599:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789428014.048603:0:17177:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789428014.048607:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.048608:0:17177:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789428014.048611:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789428014.048615:0:17177:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1789428014.048636:0:17177:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789428014.048639:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428014.048649:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff919581dd8000) 00000020:00000080:2.0:1789428014.048662:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789428014.048668:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789428014.048738:0:17177:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789428014.048744:0:17177:0:(osd_handler.c:8926:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789428014.048751:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede51949d 00010000:00080000:2.0:1789428014.048781:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196867e4800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428014.048986:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789428014.049049:0:17177:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789428014.049062:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1789428014.049320:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121216:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789428014.049373:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940121216 offset 0 length 520: 4 00000040:00080000:2.0:1789428014.055315:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789428014.056058:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940121088:12345-0@lo:38:llog_process_th.0 Request processed in 34519us (34707us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789428014.056071:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789428014.056198:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428014.056205:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428014.056209:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121088:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789428014.056311:0:17177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789428014.056525:0:17177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789428014.056878:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789428014.056882:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789428014.057797:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789428014.057809:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428014.057843:0:17177:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789428014.057861:0:17177:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede5194a4 00000100:00080000:2.0:1789428014.057869:0:17177:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428014.057878:0:17177:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428014.057925:0:17177:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bc000 x1876350940121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428014.057988:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121344:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789428014.058038:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940121344 offset 0 length 520: 4 00000100:00080000:2.0:1789428014.058159:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789428014.058222:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428014.058226:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.058228:0:17177:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789428014.058231:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428014.058234:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.058236:0:17177:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789428014.058239:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789428014.058241:0:17177:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789428014.058243:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428014.058245:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.058246:0:17177:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789428014.058248:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428014.058250:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428014.058252:0:17177:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789428014.058255:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789428014.058284:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17177:1876350940121472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428014.058334:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428014.058354:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698419180 going to sleep for 11 seconds 00000100:00100000:2.0:1789428014.058604:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121472 00000100:00100000:2.0:1789428014.058612:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121472 00000100:00100000:2.0:1789428014.058658:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428014.058668:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17177:x1876350940121472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428014.058816:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17177:x1876350940121472:12345-0@lo:502:llog_process_th.0 Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428014.058823:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428014.058936:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17177:1876350940121472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789428014.058961:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428014.058966:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428014.058967:0:17177:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789428014.058970:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789428014.059114:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789428014.059135:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789428014.059161:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428014.059172:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428014.059181:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bfad4800 from 1 10000000:01000000:2.0:1789428014.059184:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789428014.059210:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428014.059219:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428014.059228:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428014.059242:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428014.059272:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428014.059357:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968133a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.059525:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121600 00000100:00100000:1.0:1789428014.059531:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121600 00000100:00100000:1.0:1789428014.059586:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428014.059594:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+9:17138:x1876350940121600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428014.059604:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428014.059618:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5194ab expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.059640:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5194ab expref: 10 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.059650:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194ab expref: 10 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.059658:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46400, rc 0) 00000100:00100000:1.0:1789428014.059737:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+10:17138:x1876350940121600:12345-0@lo:101:mount.lustre.0 Request processed in 143us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.059744:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789428014.059813:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428014.059827:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.059836:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.060665:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121728:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789428014.060747:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.060804:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679300 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.061739:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121728 00000100:00100000:1.0:1789428014.061748:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121728 00000100:00100000:1.0:1789428014.061805:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428014.061815:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+10:17138:x1876350940121728:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789428014.061834:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789428014.061840:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789428014.061940:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+10:17138:x1876350940121728:12345-0@lo:256:mount.lustre.0 Request processed in 127us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.061948:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789428014.062037:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121728:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789428014.062730:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428014.062749:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.062762:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428014.062772:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bfad4800 from 1 10000000:01000000:3.0:1789428014.062775:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789428014.062809:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.062817:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.062826:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.062842:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428014.062877:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.062908:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679300 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.062989:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121856 00000100:00100000:0.0:1789428014.062995:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121856 00000100:00100000:0.0:1789428014.063023:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428014.063030:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+10:17138:x1876350940121856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428014.063040:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428014.063054:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5194b9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.063076:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.063088:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.063096:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f400, rc 0) 00000100:00100000:0.0:1789428014.063137:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940121856:12345-0@lo:101:mount.lustre.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.063143:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789428014.063246:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428014.063258:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.063267:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.063321:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428014.063356:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.063385:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679300 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.063441:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940121984 00000100:00100000:0.0:1789428014.063445:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940121984 00000100:00100000:0.0:1789428014.063473:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428014.063480:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940121984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428014.063680:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940121984:12345-0@lo:501:mount.lustre.0 Request processed in 200us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.063686:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428014.063805:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940121984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428014.063832:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428014.063868:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.063905:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679300 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.063944:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122112 00000100:00100000:1.0:1789428014.063949:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122112 00000100:00100000:1.0:1789428014.063979:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428014.063986:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940122112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428014.064073:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940122112:12345-0@lo:503:mount.lustre.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.064080:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428014.064204:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428014.064753:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17187:1876350940122240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428014.064801:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428014.064824:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.064910:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122240 00000100:00100000:1.0:1789428014.064915:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122240 00000100:00100000:1.0:1789428014.064941:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428014.064948:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17187:x1876350940122240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789428014.065484:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17187:x1876350940122240:12345-0@lo:502:llog_process_th.0 Request processed in 535us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.065492:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428014.065679:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17187:1876350940122240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789428014.065704:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428014.065715:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.065718:0:17187:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789428014.065724:0:17187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bfad4800 00000020:00000080:0.0:1789428014.065727:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428014.065736:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428014.065739:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.065740:0:17187:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789428014.065742:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428014.065745:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.065746:0:17187:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789428014.065749:0:17187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bfad4800 00000020:00000080:0.0:1789428014.065752:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428014.065857:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428014.065862:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.065864:0:17187:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789428014.065866:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428014.065869:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.065870:0:17187:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428014.065873:0:17187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bfad4800 00000020:00000080:0.0:1789428014.065875:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428014.069499:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428014.069533:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.069542:0:17187:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428014.069547:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428014.069551:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.069552:0:17187:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789428014.069557:0:17187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bfad4800 00000020:00000080:0.0:1789428014.069560:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789428014.069715:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17187:1876350940122368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428014.069796:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428014.069835:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122368 00000100:00100000:0.0:1789428014.069843:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122368 00000100:00100000:0.0:1789428014.069898:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428014.069907:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17187:x1876350940122368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428014.070018:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17187:x1876350940122368:12345-0@lo:502:llog_process_th.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.070026:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428014.070084:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.070104:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17187:1876350940122368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789428014.070130:0:17187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428014.070135:0:17187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428014.070136:0:17187:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789428014.070139:0:17187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789428014.079171:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789428014.079212:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789428014.079270:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.079283:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428014.079345:0:17138:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789428014.079348:0:17138:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196bfad4800 10000000:01000000:3.0:1789428014.079351:0:17138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196bfad4800 10000000:01000000:3.0:1789428014.079355:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789428014.079361:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bfad4800 from 1 10000000:01000000:3.0:1789428014.079364:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789428014.079399:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.079409:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.079449:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.079483:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428014.079548:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.079583:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.081736:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122496 00000100:00100000:1.0:1789428014.081748:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122496 00000100:00100000:1.0:1789428014.081806:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789428014.081816:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17138:x1876350940122496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428014.081832:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428014.081851:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47e00/0x84fc867ede5194ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5194c7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.081880:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47e00/0x84fc867ede5194ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5194c7 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.081902:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47e00/0x84fc867ede5194ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194c7 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428014.081911:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47e00, rc 0) 00000100:00100000:1.0:1789428014.081984:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940122496:12345-0@lo:101:mount.lustre.0 Request processed in 169us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.081999:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428014.082098:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428014.082115:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.082125:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.082195:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428014.082228:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.082267:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.083730:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122624 00000100:00100000:1.0:1789428014.083743:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122624 00000100:00100000:1.0:1789428014.083786:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789428014.083796:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940122624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428014.083982:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940122624:12345-0@lo:501:mount.lustre.0 Request processed in 187us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.083991:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428014.084105:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428014.084152:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428014.084203:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.084270:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.091379:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122752 00000100:00100000:1.0:1789428014.091393:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122752 00000100:00100000:1.0:1789428014.091471:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789428014.091482:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940122752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428014.092091:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940122752:12345-0@lo:503:mount.lustre.0 Request processed in 609us (7885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.092100:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428014.092223:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940122752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428014.094538:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940122880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789428014.094727:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.095721:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196988e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428014.096914:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940122880 00000100:00100000:2.0:1789428014.096925:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940122880 00000100:00100000:2.0:1789428014.097014:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428014.097026:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940122880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428014.102913:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940122880:12345-0@lo:502:llog_process_th.0 Request processed in 5866us (8164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428014.102929:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789428014.105178:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940122880:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789428014.105258:0:17193:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789428014.105274:0:17193:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9196bbde3380) 00000020:00000080:3.0:1789428014.105294:0:17193:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789428014.105400:0:17193:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bfad4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789428014.105405:0:17193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bfad4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789428014.105437:0:17193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bfad4800 4 00010000:00080000:3.0:1789428014.105468:0:17193:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919690577800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789428014.107577:0:17193:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789428014.108200:0:17193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789428014.108244:0:17193:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789428014.108257:0:17193:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x84fc867ede5194dc 00000100:00080000:3.0:1789428014.108268:0:17193:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428014.108281:0:17193:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff919690577800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428014.108317:0:17193:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196ad92b800 x1876350940123008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428014.108357:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940123008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428014.108461:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.108532:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123008 00000100:00100000:3.0:1789428014.108539:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123008 00000100:00100000:3.0:1789428014.108569:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428014.108577:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940123008:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428014.109952:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940123008:12345-0@lo:38:llog_process_th.0 Request processed in 1368us (1485us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789428014.109964:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428014.110091:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428014.110099:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919690577800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428014.110112:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789428014.110116:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940123008:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789428014.110152:0:17193:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789428014.113045:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940123136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428014.113128:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.113181:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698679840 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.113453:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123136 00000100:00100000:0.0:1789428014.113461:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123136 00000100:00100000:0.0:1789428014.113507:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789428014.113516:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940123136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428014.113795:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940123136:12345-0@lo:502:llog_process_th.0 Request processed in 279us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.113803:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789428014.114650:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940123136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428014.114704:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940123264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428014.114745:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.114771:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.117723:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123264 00000100:00100000:0.0:1789428014.117736:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123264 00000100:00100000:0.0:1789428014.117783:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789428014.117791:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940123264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428014.117947:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17193:x1876350940123264:12345-0@lo:502:llog_process_th.0 Request processed in 156us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.117955:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789428014.118342:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c098993-d5b4-48be-b0c2-bdb904c28b81:17193:1876350940123264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789428014.118379:0:17193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789428014.118779:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789428014.118806:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789428014.119919:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.119933:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789428014.119987:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789428014.119989:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789428014.119990:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428014.119992:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428014.119993:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428014.119994:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428014.119995:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428014.119997:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789428014.119998:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428014.120000:0:17138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428014.120003:0:17138:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789428014.120005:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428014.120007:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789428014.120008:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428014.120009:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428014.120010:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428014.120011:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428014.120012:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428014.120013:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789428014.120017:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428014.120018:0:17138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428014.120042:0:17138:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789428014.120058:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940123392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428014.120113:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428014.120153:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428014.120188:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123392 00000100:00100000:1.0:1789428014.120195:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123392 00000100:00100000:1.0:1789428014.120242:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789428014.120251:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940123392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428014.120275:0:17152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789428014.120286:0:17152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789428014.123198:0:17152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789428014.123249:0:17152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789428014.123831:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17138:x1876350940123392:12345-0@lo:253:mount.lustre.0 Request processed in 3577us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.123843:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428014.124138:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17138:1876350940123392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789428014.124151:0:17138:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789428014.124155:0:17138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789428014.124156:0:17138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789428014.124158:0:17138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428014.124159:0:17138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428014.124160:0:17138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428014.124161:0:17138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428014.124162:0:17138:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428014.124164:0:17138:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789428014.124166:0:17138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428014.124167:0:17138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789428014.124184:0:17138:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789428014.128539:0:17175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789428014.128547:0:17175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789428014.128792:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.128812:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194ab expref: 11 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.128819:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.128859:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 11 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428014.128873:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 11 pid: 17152 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428014.128886:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940123520:0@lo:104: 00000100:00100000:3.0:1789428014.129029:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428014.129111:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789428014.129233:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123520 00000100:00100000:0.0:1789428014.129242:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123520 00000100:00100000:0.0:1789428014.129560:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428014.129570:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940123520:12345-0@lo:104: 00010000:00010000:0.0:1789428014.129584:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.129728:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789428014.129735:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940123520:12345-0@lo:104: Request processed in 167us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.129741:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428014.129806:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940123520:0@lo:104: 00010000:00010000:2.0:1789428014.129824:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131093:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428014.131102:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131111:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428014.131115:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131141:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428014.131149:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428014.131155:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428014.131199:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131205:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428014.131235:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131242:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91958375c400/0x84fc867ede5194ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194b2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131259:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428014.131261:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428014.131263:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428014.131289:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428014.131300:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940123648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428014.131350:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428014.131407:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123648 00000100:00100000:0.0:1789428014.131441:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123648 00010000:00010000:0.0:1789428014.131466:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 12 pid: 17152 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428014.131491:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428014.131505:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:3613:x1876350940123648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428014.131516:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428014.131521:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 12 pid: 17152 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131531:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 12 pid: 17152 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131542:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46400/0x84fc867ede5194b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5194ab expref: 12 pid: 17152 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131555:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131562:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789428014.131575:0:17144:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003029756s 00010000:00010000:0.0:1789428014.131579:0:17144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131586:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131593:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131675:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131681:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428014.131693:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131701:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131717:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131728:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428014.131764:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:3613:x1876350940123648:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428014.131770:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428014.131818:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940123648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428014.131836:0:17175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131844:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428014.131850:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ed200/0x84fc867ede5194e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789428014.137739:0:17138:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789428014.138265:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789428014.138525:0:17198:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789428014.138529:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789428014.141266:0:17199:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789428014.141806:0:17199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789428014.143055:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1789428014.145262:0:17199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789428014.145350:0:17199:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1789428014.145741:0:17200:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9195831bed80 x1876350940123776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428014.145754:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000040:01000000:3.0:1789428014.146376:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789428014.146667:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789428014.147174:0:17138:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789428014.147182:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789428014.147229:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428014.148909:0:17138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789428014.149545:0:17138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789428014.149579:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789428014.152056:0:17138:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789428014.154171:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789428014.156087:0:17138:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789428014.156124:0:17138:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb489c145f988 00100000:10000000:2.0:1789428014.156132:0:17138:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789428014.157770:0:17138:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789428014.157786:0:17138:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789428014.157804:0:17138:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789428014.157820:0:17138:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789428014.164058:0:17138:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428014.164315:0:17138:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789428014.832637:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789428015.088471:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789428015.088481:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bfad4800 from 7 10000000:01000000:3.0:1789428015.088486:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428015.088539:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.088552:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.088564:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428015.088591:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940123904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428015.088670:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428015.088743:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789428015.090193:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123904 00000100:00100000:2.0:1789428015.090207:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123904 00000100:00100000:2.0:1789428015.090282:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789428015.090293:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+11:17156:x1876350940123904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428015.090310:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428015.090333:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5194ea expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.090366:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5194ea expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.090379:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194ea expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.090388:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375de00, rc 0) 00000100:00100000:2.0:1789428015.090495:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17156:x1876350940123904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.090501:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789428015.092642:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940123904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428015.092673:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.092702:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428015.092941:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940124032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428015.093031:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428015.093081:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428015.093137:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124032 00000100:00100000:1.0:1789428015.093145:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124032 00000100:00100000:1.0:1789428015.093199:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789428015.093208:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17156:x1876350940124032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428015.093231:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428015.093320:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428015.093325:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789428015.093441:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17156:x1876350940124032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 233us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428015.093449:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789428015.093576:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940124032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428015.093620:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428015.093628:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.093638:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428015.152615:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000040:00080000:0.0:1789428015.162565:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789428015.857981:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789428016.177460:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789428016.177928:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:1.0:1789428016.880756:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428017.200530:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:0.0:1789428017.904682:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428018.224576:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000001:02000400:3.0:1789428018.526319:0:17443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789428018.933889:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428019.249688:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000100:00080000:0.0:1789428019.505675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789428019.505683:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789428019.505687:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428019.505698:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 358 00000100:00080000:0.0:1789428019.505706:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789428019.505721:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196905eb000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428019.505753:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fca300 x1876350940124288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428019.505773:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428019.505778:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428019.505781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428019.505784:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428019.505798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789428019.505802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789428019.505804:0:37:0:(import.c:65:import_set_state_nolock()) ffff919690577800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428019.505811:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff919690577800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428019.505850:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc9180 x1876350940124416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428019.506070:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940124160:0@lo:400:kworker.0 00000100:00100000:0.0:1789428019.506164:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428019.506240:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124160 00000100:00100000:0.0:1789428019.506250:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124160 00000100:00100000:0.0:1789428019.506303:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428019.506313:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:3615:x1876350940124160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428019.506371:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:3615:x1876350940124160:12345-0@lo:400:kworker.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428019.506379:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428019.506451:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124288:0@lo:38:kworker.0 00000100:00100000:1.0:1789428019.511650:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940124160:0@lo:400:kworker.0 00000100:00100000:0.0:1789428019.512662:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428019.512748:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940124416:0@lo:38:kworker.0 00000100:00100000:2.0:1789428019.512761:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124288 00000100:00100000:2.0:1789428019.512777:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124288 00000100:00100000:0.0:1789428019.512836:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428019.513025:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428019.513036:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940124288:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789428019.513064:0:17165:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789428019.517798:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124416 00000100:00100000:3.0:1789428019.517829:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124416 00000100:00100000:3.0:1789428019.517983:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428019.517996:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940124416:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789428019.518039:0:17161:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:3.0:1789428019.518093:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x84fc867ede5194f8 00000004:00100000:3.0:1789428019.518129:0:17161:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789428019.518302:0:17161:0:(import.c:65:import_set_state_nolock()) ffff919582431000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428019.518672:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1876350940124416:12345-0@lo:38:kworker.0 Request processed in 675us (5833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428019.518681:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789428019.518773:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff919583fc9180 x1876350940124416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789428019.518796:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789428019.518807:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789428019.519526:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789428019.519533:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919690577800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428019.519624:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940124416:0@lo:38:kworker.0 00000100:00100000:2.0:1789428019.535659:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940124288:12345-0@lo:38:kworker.0 Request processed in 22616us (22997us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428019.535675:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789428019.535765:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428019.535772:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428019.535778:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124288:0@lo:38:kworker.0 00000020:00000004:0.0:1789428019.542049:0:17495:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428019.543497:0:17495:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428019.952652:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428020.272782:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000020:00000004:0.0:1789428020.369589:0:17545:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428020.369914:0:17545:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789428020.981588:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428021.296551:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:0.0:1789428022.000539:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428022.320510:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:0.0:1789428023.026533:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428023.344672:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:0.0:1789428024.048840:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428024.370113:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000100:00100000:3.0:1789428024.625496:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428014/real 1789428014] req@ffff9195831bc000 x1876350940121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428024 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428024.625526:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831bc000 x1876350940121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428024 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428024.625538:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428014/real 1789428014] req@ffff9195831bf100 x1876350940121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428024 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428024.625553:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831bf100 x1876350940121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428024 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789428024.625571:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428024.627991:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428024.628002:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121344:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789428024.628022:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428024.628038:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428024.628042:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940121216:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789428024.628183:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789428024.628187:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789428024.628190:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428024.628195:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 363 00000100:00080000:1.0:1789428024.628199:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789428024.628216:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196905eb000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428024.628236:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f9f80 x1876350940124672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428024.628248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428024.628251:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789428024.628252:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428024.628255:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 358 00000100:00080000:1.0:1789428024.628257:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789428024.628261:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9196ad917000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428024.628270:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f9500 x1876350940124800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428024.628277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428024.628280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789428024.628281:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428024.628284:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 358 00000100:00080000:1.0:1789428024.628286:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789428024.628290:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428024.628298:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f8380 x1876350940124928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428024.628337:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789428024.628349:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940125056:0@lo:400:kworker.0 00000100:00100000:0.0:1789428024.628359:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940124544:0@lo:400:kworker.0 00000100:00100000:2.0:1789428024.628454:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124672:0@lo:38:kworker.0 00000100:00100000:1.0:1789428024.628655:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428024.628655:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428024.628747:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428024.628810:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124800:0@lo:8:kworker.0 00000100:00100000:3.0:1789428024.628826:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125056 00000400:00000100:2.0:1789428024.628831:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940124800 offset 0 length 520: 4 00000100:00100000:3.0:1789428024.628834:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125056 00000100:00100000:2.0:1789428024.628842:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124928:0@lo:8:kworker.0 00000400:00000100:2.0:1789428024.628857:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940124928 offset 0 length 520: 4 00000100:00100000:3.0:1789428024.628873:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428024.628882:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428024.628900:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124672 00000100:00100000:0.0:1789428024.628904:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124672 00000100:00100000:3.0:1789428024.628937:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940125056:12345-0@lo:400:kworker.0 Request processed in 55us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.628959:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789428024.628964:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940124672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789428024.628979:0:17164:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789428024.629016:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428024.629040:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940124544 00000100:00100000:3.0:1789428024.629044:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940124544 00000100:00100000:3.0:1789428024.629101:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789428024.629108:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:3616:x1876350940124544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428024.629143:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:3616:x1876350940124544:12345-0@lo:400:kworker.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428024.629149:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789428024.629227:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9196bf9f9880 x1876350940125056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428024.629239:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940125056:0@lo:400:kworker.0 00000100:00100000:3.0:1789428024.629261:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940124544:0@lo:400:kworker.0 00000100:00100000:0.0:1789428024.634485:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940124672:12345-0@lo:38:kworker.0 Request processed in 5511us (5729us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428024.634499:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789428024.634553:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428024.634559:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789428024.634562:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124672:0@lo:38:kworker.0 00010000:00010000:2.0:1789428025.076395:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428025.394780:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000020:01000004:2.0:1789428025.709462:0:17890:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789428025.709470:0:17890:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789428025.709472:0:17890:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789428025.709630:0:17890:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919698b0d800 00000020:01000004:2.0:1789428025.709651:0:17890:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789428025.709668:0:17890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789428025.709688:0:17890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff919581ddcd40) 00000020:00000080:2.0:1789428025.709710:0:17890:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789428025.766145:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789428025.766403:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.769778:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.770063:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.770253:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.770776:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.771012:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.771562:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.771866:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.772112:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.772352:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.772705:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.773009:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789428025.773245:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789428025.774080:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.774267:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.774587:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.775081:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.775327:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.775636:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.775898:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.776130:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.776367:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.776755:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.777010:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.777206:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789428025.777472:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.777763:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789428025.777987:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.779824:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.782118:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.783017:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.783410:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.783817:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.784232:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.784468:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.784696:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.785590:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.785999:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.786253:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789428025.786628:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.787002:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.787553:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.788006:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.788559:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789428025.789876:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:2.0:1789428025.795090:0:17890:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789428025.795300:0:17890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789428025.795311:0:17890:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789428025.795322:0:17890:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519506 00000020:01000004:2.0:1789428025.795329:0:17890:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789428025.795349:0:17890:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789428025.795352:0:17890:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789428025.795358:0:17890:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789428025.795386:0:17890:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789428025.795390:0:17890:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789428025.799974:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789428025.800009:0:17890:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789428025.800014:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789428025.800016:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789428025.800017:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428025.800019:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428025.800020:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428025.800026:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428025.800027:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428025.800029:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428025.800030:0:17890:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789428025.800034:0:17890:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789428025.800036:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789428025.800037:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789428025.800038:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428025.800039:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428025.800040:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428025.800041:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428025.800042:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428025.800043:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428025.800043:0:17890:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789428025.800080:0:17890:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789428025.800102:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789428025.800165:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.800248:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969899a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.801320:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125184 00000100:00100000:0.0:1789428025.801331:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125184 00000100:00100000:0.0:1789428025.801393:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428025.801434:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17890:x1876350940125184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789428025.801480:0:17152:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789428025.801483:0:17152:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789428025.801491:0:17152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789428025.802022:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17890:x1876350940125184:12345-0@lo:253:mount.lustre.0 Request processed in 609us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.802030:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789428025.802122:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789428025.802134:0:17890:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789428025.802137:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789428025.802139:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789428025.802140:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428025.802142:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428025.802143:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428025.802145:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428025.802146:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428025.802147:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428025.802149:0:17890:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789428025.802168:0:17890:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919698b0d800 from lustre-MDT0001 10000000:01000000:2.0:1789428025.802195:0:17890:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789428025.802198:0:17890:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789428025.802205:0:17890:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91958302b380 local copy 00010000:00010000:2.0:1789428025.802213:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428025.802310:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428025.802343:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.802380:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b0790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428025.802939:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125312 00000100:00100000:3.0:1789428025.802946:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125312 00000100:00100000:3.0:1789428025.802992:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428025.803000:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17890:x1876350940125312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428025.803075:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17890:x1876350940125312:12345-0@lo:501:mount.lustre.0 Request processed in 76us (733us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428025.803082:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789428025.803160:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125312:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789428025.803175:0:17890:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789428025.803194:0:17890:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789428025.803201:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803212:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428025.803240:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919698b0d800 10000000:01000000:2.0:1789428025.803245:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789428025.803250:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91958302b380 10000000:01000000:2.0:1789428025.803253:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789428025.803256:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91958302b380 from 1 10000000:01000000:2.0:1789428025.803259:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789428025.803285:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803293:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803303:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428025.803330:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428025.803355:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.803385:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b0790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.803512:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125440 00000100:00100000:0.0:1789428025.803518:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125440 00000100:00100000:0.0:1789428025.803554:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789428025.803561:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+12:17890:x1876350940125440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428025.803570:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428025.803584:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f200/0x84fc867ede519514 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51950d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.803613:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f200/0x84fc867ede519514 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51950d expref: 13 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.803624:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f200/0x84fc867ede519514 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51950d expref: 13 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.803632:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f200, rc 0) 00000100:00100000:0.0:1789428025.803663:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+13:17890:x1876350940125440:12345-0@lo:101:mount.lustre.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.803669:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789428025.803756:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428025.803769:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803777:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428025.803812:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789428025.803823:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803830:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428025.803848:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff919698b0d800 10000000:01000000:2.0:1789428025.803853:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789428025.803856:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff919698b0d800 from 1 10000000:01000000:2.0:1789428025.803858:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789428025.803873:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803880:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.803886:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428025.803905:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428025.803930:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.803949:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b0790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.804072:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125568 00000100:00100000:1.0:1789428025.804077:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125568 00000100:00100000:1.0:1789428025.804098:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789428025.804105:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+13:17890:x1876350940125568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428025.804112:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428025.804120:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47800/0x84fc867ede519522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51951b expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.804134:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47800/0x84fc867ede519522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51951b expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.804142:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47800/0x84fc867ede519522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51951b expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.804148:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47800, rc 0) 00000100:00100000:1.0:1789428025.804187:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+14:17890:x1876350940125568:12345-0@lo:101:mount.lustre.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.804193:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428025.804660:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428025.804671:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.804679:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428025.804689:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789428025.804695:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.804703:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428025.804709:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789428025.804712:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428025.804716:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff919698b0d800 10000000:01000000:2.0:1789428025.804719:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789428025.804723:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789428025.804725:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789428025.804740:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.804747:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.804763:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428025.804776:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428025.804817:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428025.804962:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125696 00000100:00100000:1.0:1789428025.804967:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125696 00000100:00100000:1.0:1789428025.805003:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789428025.805012:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+14:17890:x1876350940125696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428025.805020:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428025.805029:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46200/0x84fc867ede519530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519529 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.805044:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46200/0x84fc867ede519530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519529 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.805066:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46200/0x84fc867ede519530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519529 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.805073:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46200, rc 0) 00000100:00100000:1.0:1789428025.805100:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940125696:12345-0@lo:101:mount.lustre.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.805106:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789428025.810769:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b0790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428025.810822:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428025.810954:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.810969:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428025.813543:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789428025.816084:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428025.821072:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789428025.821129:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789428025.821146:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789428025.821159:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789428025.821294:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789428025.821314:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789428025.821329:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789428025.821342:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789428025.821357:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789428025.821371:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789428025.821386:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789428025.821404:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789428025.821763:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789428025.821779:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789428025.821807:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789428025.821820:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789428025.821835:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789428025.821850:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789428025.821865:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789428025.821881:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789428025.821898:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789428025.821911:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789428025.821924:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789428025.821950:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789428025.821956:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789428025.822056:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428025.822122:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.822298:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb84180 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.822346:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125824 00000100:00100000:0.0:1789428025.822354:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125824 00000100:00100000:0.0:1789428025.822662:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789428025.822672:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940125824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428025.822863:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940125824:12345-0@lo:501:mount.lustre.0 Request processed in 193us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.822870:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789428025.822949:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428025.822975:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428025.823016:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.823077:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb84180 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.823111:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940125952 00000100:00100000:0.0:1789428025.823116:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940125952 00000100:00100000:0.0:1789428025.823147:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789428025.823153:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940125952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428025.823894:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940125952:12345-0@lo:503:mount.lustre.0 Request processed in 739us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.823902:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789428025.823964:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940125952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428025.824402:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428025.824603:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940126080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428025.824642:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.824665:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428025.824793:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126080 00000100:00100000:2.0:1789428025.824799:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126080 00000100:00100000:2.0:1789428025.824836:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789428025.824844:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940126080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428025.825340:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940126080:12345-0@lo:502:mount.lustre.0 Request processed in 496us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.825349:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428025.825373:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940126080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428025.825546:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789428025.825576:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789428025.825591:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789428025.825603:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789428025.825616:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789428025.825632:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789428025.825645:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789428025.825671:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789428025.825687:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789428025.825701:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789428025.825715:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789428025.825729:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789428025.825743:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789428025.825755:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789428025.825768:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789428025.825815:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789428025.825833:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789428025.825847:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789428025.825859:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789428025.825872:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789428025.825885:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789428025.825898:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789428025.825912:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789428025.825938:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789428025.825953:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789428025.825966:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789428025.825978:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789428025.825991:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789428025.826005:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789428025.826018:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789428025.826030:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789428025.826043:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789428025.826055:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789428025.826070:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789428025.826095:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789428025.826108:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789428025.826122:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789428025.826135:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789428025.826148:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789428025.826244:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789428025.826263:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789428025.826276:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789428025.826290:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789428025.826304:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789428025.826328:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940126208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428025.826373:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.826482:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.826517:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126208 00000100:00100000:0.0:1789428025.826523:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126208 00000100:00100000:0.0:1789428025.826606:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428025.826615:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940126208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428025.826709:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940126208:12345-0@lo:502:mount.lustre.0 Request processed in 95us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.826716:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789428025.826776:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940126208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428025.826821:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789428025.826830:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789428025.827954:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428025.827965:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.827967:0:17894:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789428025.827972:0:17894:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789428025.827975:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428025.827987:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9196bcb40000) 00000020:00000080:0.0:1789428025.828007:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789428025.828012:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789428025.828096:0:17894:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789428025.828102:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede51953e 00000020:00000080:0.0:1789428025.828317:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789428025.828322:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428025.828325:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.828327:0:17894:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789428025.828330:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428025.828333:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.828335:0:17894:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789428025.828338:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428025.828345:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9196bcb44d40) 00000020:00000080:0.0:1789428025.828355:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789428025.828359:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789428025.828361:0:17894:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789428025.828364:0:17894:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789428025.828369:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789428025.828448:0:17894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919698b0d800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789428025.828993:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9196bcb419c0) 00000020:00000080:0.0:1789428025.829012:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789428025.829093:0:17894:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789428025.829100:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519553 00000020:00000080:0.0:1789428025.829265:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789428025.829272:0:17894:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789428025.829277:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x84fc867ede51955a 00080000:01000000:0.0:1789428025.829282:0:17894:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789428025.829287:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519561 00010000:00010000:2.0:1789428025.913137:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789428025.916175:0:17894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789428025.916732:0:17894:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789428025.919497:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789428025.919512:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428025.919519:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.919522:0:17894:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789428025.919526:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428025.919531:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.919533:0:17894:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789428025.919536:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789428025.919542:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:2.0:1789428025.919568:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428025.919590:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff919688454d40) 00000020:00000080:2.0:1789428025.919614:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789428025.919634:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789428025.919723:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789428025.919730:0:17894:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789428025.919737:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede51956f 00010000:00080000:2.0:1789428025.919768:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919583ec9000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428025.923081:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789428025.930152:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789428025.930167:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789428025.930209:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789428025.930226:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519576 00000100:00080000:0.0:1789428025.930235:0:17894:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428025.930246:0:17894:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff919583ec9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428025.930278:0:17894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc8a80 x1876350940126336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428025.930305:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789428025.930351:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428025.930354:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930356:0:17894:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789428025.930358:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789428025.930361:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789428025.930362:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428025.930364:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428025.930365:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789428025.930367:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930368:0:17894:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789428025.930370:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428025.930374:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930375:0:17894:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789428025.930378:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789428025.930404:0:17894:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789428025.930438:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126336:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789428025.930457:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428025.930479:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930480:0:17894:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789428025.930483:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789428025.930485:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789428025.930486:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428025.930487:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428025.930488:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789428025.930490:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930492:0:17894:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789428025.930494:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789428025.930497:0:17894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789428025.930500:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428025.930502:0:17894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000100:00100000:3.0:1789428025.930504:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789428025.930504:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789428025.930508:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:0.0:1789428025.930529:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789428025.930531:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428025.930542:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9196888919c0) 00000020:00000080:0.0:1789428025.930554:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789428025.930559:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1789428025.930707:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789428025.930712:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789428025.930715:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428025.930721:0:16602:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 369 00000100:00080000:1.0:1789428025.930725:0:16602:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789428025.930730:0:16602:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196905eb000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428025.930732:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126336 00000100:00100000:2.0:1789428025.930741:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126336 00000100:00100000:1.0:1789428025.930746:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9fad80 x1876350940126464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428025.930770:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789428025.930774:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789428025.930774:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428025.930776:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.930788:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428025.930790:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940126336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789428025.930812:0:17165:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 370 last 0 00000100:00100000:1.0:1789428025.930821:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940126592:0@lo:400:kworker.0 00000100:00100000:1.0:1789428025.930851:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428025.930890:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126592 00000100:00100000:1.0:1789428025.930894:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126592 00000100:00100000:3.0:1789428025.930924:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940126464:0@lo:38:kworker.0 00000100:00100000:1.0:1789428025.930925:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428025.930937:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428025.930950:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428025.930977:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940126592:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.930984:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428025.930994:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789428025.931001:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:1.0:1789428025.931022:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9196bf9fbb80 x1876350940126592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428025.931035:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940126592:0@lo:400:kworker.0 00000020:00000080:2.0:1789428025.931041:0:17165:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519584 00000004:00100000:2.0:1789428025.931055:0:17165:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789428025.931062:0:17165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:0.0:1789428025.931254:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789428025.931261:0:17894:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789428025.931268:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede51958b 00000100:00100000:3.0:1789428025.931279:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126464 00000100:00100000:3.0:1789428025.931283:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126464 00010000:00080000:0.0:1789428025.931312:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196b5aab000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.124@tcp at head 00000100:00100000:2.0:1789428025.931398:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428025.931403:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940126464:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789428025.931473:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940126464:12345-0@lo:38:kworker.0 Request processed in 67us (521us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789428025.931480:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789428025.931543:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789428025.931571:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428025.931588:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428025.931592:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789428025.931595:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940126464:0@lo:38:kworker.0 00000040:01000000:0.0:1789428025.932710:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789428025.933467:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789428025.934093:0:17165:0:(import.c:65:import_set_state_nolock()) ffff919583d57800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428025.934181:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940126336:12345-0@lo:38:llog_process_th.0 Request processed in 3398us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.934188:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428025.934254:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428025.934261:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789428025.934267:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789428025.934271:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789428025.934273:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428025.934288:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789428025.934388:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428025.934402:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940126720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428025.934757:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.934830:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940126720 00000100:00100000:3.0:1789428025.934840:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940126720 00000100:00100000:3.0:1789428025.934877:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428025.934884:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350940126720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428025.934908:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428025.934982:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1876350940126720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428025.934988:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428025.935269:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940126720:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789428025.935890:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428025.936073:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789428025.936201:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789428025.936586:0:17900:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789428025.936591:0:17900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789428025.937215:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789428025.937227:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428025.937264:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789428025.937285:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519592 00000100:00080000:2.0:1789428025.937295:0:17894:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428025.937306:0:17894:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196b5aab000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428025.937339:0:17894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bdc00 x1876350940126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428025.937370:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789428025.937450:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.937455:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789428025.937458:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1789428025.937458:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.937461:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1789428025.937462:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.937464:0:17894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789428025.937467:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789428025.937469:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1789428025.937470:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428025.937472:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428025.937473:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428025.937475:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.937476:0:17894:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428025.937479:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789428025.937483:0:17894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789428025.937486:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.937488:0:17894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789428025.937491:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789428025.937494:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1789428025.937515:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789428025.937518:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428025.937527:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9196884519c0) 00000100:00100000:3.0:1789428025.937529:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126848:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1789428025.937539:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789428025.937544:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789428025.937634:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789428025.937644:0:17894:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789428025.937650:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede5195a0 00010000:00080000:2.0:1789428025.937677:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196b5b0e000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.124@tcp at head 00000400:00000100:3.0:1789428025.937721:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940126848 offset 0 length 520: 4 00010000:00010000:2.0:1789428025.937887:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789428025.937949:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789428025.937963:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789428025.942922:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428025.943240:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789428025.943369:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789428025.943966:0:17902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789428025.943972:0:17902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789428025.944934:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789428025.944948:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428025.944989:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789428025.945015:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede5195a7 00000100:00080000:2.0:1789428025.945029:0:17894:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428025.945042:0:17894:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9196b5b0e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428025.945082:0:17894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831be300 x1876350940126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428025.945147:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126976:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789428025.945205:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940126976 offset 0 length 520: 4 00000100:00080000:2.0:1789428025.945264:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789428025.945374:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428025.945379:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.945381:0:17894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789428025.945385:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428025.945389:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.945390:0:17894:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789428025.945393:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789428025.945395:0:17894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789428025.945397:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428025.945400:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.945401:0:17894:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789428025.945437:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428025.945441:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.945443:0:17894:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789428025.945447:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789428025.945473:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428025.945475:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428025.945477:0:17894:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789428025.945480:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1789428025.945791:0:17890:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789428025.945830:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789428025.945916:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.945928:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428025.945947:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919698b0d800 from 1 10000000:01000000:3.0:1789428025.945950:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428025.945977:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.945984:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.945995:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428025.946010:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428025.946050:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.946079:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00080000:1.0:1789428025.946138:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.946144:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428025.946147:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.946150:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428025.946201:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127104 00000100:00100000:2.0:1789428025.946209:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127104 00000100:00100000:2.0:1789428025.946258:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789428025.946267:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+15:17890:x1876350940127104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428025.946283:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428025.946298:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5195ae expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.946322:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5195ae expref: 16 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.951112:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195ae expref: 16 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428025.951126:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375cc00, rc 0) 00000100:00100000:2.0:1789428025.951265:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17890:x1876350940127104:12345-0@lo:101:mount.lustre.0 Request processed in 4997us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.951274:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789428025.951400:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428025.951525:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.951548:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428025.952326:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127232:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789428025.952387:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.952557:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.952717:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127232 00000100:00100000:0.0:1789428025.952732:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127232 00000100:00100000:0.0:1789428025.952848:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789428025.952859:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17890:x1876350940127232:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789428025.952882:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789428025.952901:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789428025.952904:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789428025.953012:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17890:x1876350940127232:12345-0@lo:256:mount.lustre.0 Request processed in 155us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.953020:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789428025.953088:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127232:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789428025.953703:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428025.953763:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.953774:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428025.953792:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919698b0d800 from 1 10000000:01000000:3.0:1789428025.953795:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789428025.953827:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.953835:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.953844:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428025.953860:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428025.953892:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.954356:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.954645:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127360 00000100:00100000:1.0:1789428025.954653:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127360 00000100:00100000:1.0:1789428025.954690:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789428025.954698:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17890:x1876350940127360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428025.954710:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428025.954734:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5195bc expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.954758:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5195bc expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.954770:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195bc expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.954789:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47400, rc 0) 00000100:00100000:1.0:1789428025.954845:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127360:12345-0@lo:101:mount.lustre.0 Request processed in 140us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.954852:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789428025.954939:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428025.954952:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428025.954961:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428025.955086:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428025.955116:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428025.955155:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.955177:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.955285:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127488 00000100:00100000:1.0:1789428025.955290:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127488 00000100:00100000:1.0:1789428025.955309:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789428025.955316:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428025.955389:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127488:12345-0@lo:501:mount.lustre.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.955393:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789428025.955863:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428025.955889:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428025.955931:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.955967:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.956023:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127616 00000100:00100000:0.0:1789428025.956028:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127616 00000100:00100000:0.0:1789428025.956053:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789428025.956059:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428025.956188:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127616:12345-0@lo:503:mount.lustre.0 Request processed in 128us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.956195:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789428025.956361:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428025.956894:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428025.956955:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428025.956998:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.957074:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428025.957110:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127744 00000100:00100000:0.0:1789428025.957116:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127744 00000100:00100000:0.0:1789428025.957188:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428025.957197:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428025.957288:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127744:12345-0@lo:502:mount.lustre.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.957295:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789428025.957361:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428025.957561:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789428025.957599:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789428025.957616:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789428025.957630:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789428025.957644:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789428025.957672:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789428025.957688:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789428025.957700:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789428025.957712:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789428025.957725:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789428025.957737:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789428025.957757:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428025.957805:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.958026:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a0cb5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428025.958066:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940127872 00000100:00100000:2.0:1789428025.958072:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940127872 00000100:00100000:2.0:1789428025.958097:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789428025.958105:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428025.958237:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940127872:12345-0@lo:502:mount.lustre.0 Request processed in 133us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.958244:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789428025.960891:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940127872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428025.961004:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789428025.961019:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789428025.961586:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428025.961596:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961599:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789428025.961606:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919698b0d800 00000020:00000080:3.0:1789428025.961609:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428025.961620:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428025.961623:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961624:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789428025.961627:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428025.961629:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961631:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789428025.961635:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919698b0d800 00000020:00000080:3.0:1789428025.961637:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428025.961699:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428025.961703:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961705:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789428025.961707:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428025.961709:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961711:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428025.961714:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919698b0d800 00000020:00000080:3.0:1789428025.961715:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428025.961732:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428025.961735:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961736:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428025.961739:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428025.961741:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961743:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789428025.961746:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919698b0d800 00000020:00000080:3.0:1789428025.961748:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428025.961791:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428025.961795:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428025.961796:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789428025.961803:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789428025.961920:0:17890:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789428025.961946:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428025.961969:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.961990:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428025.962040:0:17890:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789428025.962043:0:17890:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919698b0d800 10000000:01000000:0.0:1789428025.962045:0:17890:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919698b0d800 10000000:01000000:0.0:1789428025.962050:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428025.962055:0:17890:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919698b0d800 from 1 10000000:01000000:0.0:1789428025.962058:0:17890:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789428025.962102:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.962110:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.962121:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428025.962149:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428025.962208:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.962245:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969af42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.962349:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128000 00000100:00100000:1.0:1789428025.962357:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128000 00000100:00100000:1.0:1789428025.962402:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789428025.962411:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17890:x1876350940128000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428025.962442:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428025.962455:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46000/0x84fc867ede5195d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5195ca expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.962478:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46000/0x84fc867ede5195d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5195ca expref: 18 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.962496:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46000/0x84fc867ede5195d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195ca expref: 18 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.962504:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46000, rc 0) 00000100:00100000:1.0:1789428025.962554:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128000:12345-0@lo:101:mount.lustre.0 Request processed in 143us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.962561:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428025.962704:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428025.962718:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.962727:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428025.964850:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789428025.965119:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428025.965312:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789428025.965337:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789428025.965352:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789428025.965365:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789428025.965378:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789428025.965392:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789428025.965405:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789428025.965447:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789428025.965464:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789428025.965491:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789428025.965505:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789428025.965517:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789428025.965530:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789428025.965543:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789428025.965555:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789428025.965569:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789428025.965787:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789428025.965807:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789428025.965821:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789428025.965893:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789428025.965913:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789428025.965926:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789428025.965939:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789428025.965953:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789428025.965967:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789428025.965994:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789428025.966008:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789428025.966020:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789428025.966039:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789428025.966052:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789428025.966135:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428025.966200:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.966234:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969af426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.966400:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128128 00000100:00100000:1.0:1789428025.966407:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128128 00000100:00100000:1.0:1789428025.966479:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789428025.966489:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428025.966624:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128128:12345-0@lo:501:mount.lustre.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.966632:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428025.966890:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428025.966921:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428025.966959:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.966979:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969af426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428025.968870:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128256 00000100:00100000:3.0:1789428025.968881:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128256 00000100:00100000:3.0:1789428025.968934:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789428025.968943:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428025.969085:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128256:12345-0@lo:503:mount.lustre.0 Request processed in 143us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428025.969093:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789428025.969193:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428025.970016:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428025.970094:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428025.970150:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.970238:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff91969af42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.972470:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128384 00000100:00100000:1.0:1789428025.972486:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128384 00000100:00100000:1.0:1789428025.972558:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789428025.972569:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428025.972996:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128384:12345-0@lo:502:mount.lustre.0 Request processed in 428us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.973004:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789428025.973611:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428025.973889:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789428025.974163:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789428025.974178:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789428025.974190:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789428025.974200:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789428025.974211:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789428025.974223:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789428025.974247:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789428025.974259:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789428025.974270:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789428025.974281:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789428025.974291:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789428025.974302:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789428025.974321:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789428025.974333:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789428025.974343:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789428025.974352:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789428025.974362:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789428025.974373:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789428025.974383:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789428025.974393:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789428025.974405:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789428025.974437:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789428025.974464:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789428025.974477:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789428025.974489:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789428025.974500:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789428025.974512:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789428025.974523:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789428025.974675:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789428025.974692:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789428025.974705:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789428025.974717:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789428025.974729:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789428025.974741:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789428025.974755:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789428025.974768:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789428025.974793:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789428025.974808:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789428025.974834:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789428025.974922:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789428025.974935:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789428025.974948:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789428025.974961:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789428025.974973:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789428025.974984:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789428025.975006:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789428025.975019:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789428025.975066:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428025.975141:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.975193:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.975283:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128512 00000100:00100000:1.0:1789428025.975290:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128512 00000100:00100000:1.0:1789428025.975340:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789428025.975349:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428025.975473:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128512:12345-0@lo:502:mount.lustre.0 Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.975486:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789428025.975749:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428025.976777:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789428025.976827:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789428025.977022:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428025.977082:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.979884:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.980335:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128640 00000100:00100000:1.0:1789428025.980347:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128640 00000100:00100000:1.0:1789428025.980480:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789428025.980492:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428025.980812:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128640:12345-0@lo:502:mount.lustre.0 Request processed in 322us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.980821:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789428025.983985:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428025.984078:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789428025.984092:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789428025.989124:0:17909:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789428025.989138:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff919688893380) 00000020:00000080:0.0:1789428025.989156:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789428025.989237:0:17909:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919698b0d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789428025.989240:0:17909:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919698b0d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789428025.989242:0:17909:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919698b0d800 3 00010000:00080000:0.0:1789428025.989265:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196b5aa9800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1789428025.992963:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789428025.993197:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789428025.993240:0:17909:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789428025.993254:0:17909:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x84fc867ede5195df 00000100:00080000:0.0:1789428025.993264:0:17909:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428025.993277:0:17909:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b5aa9800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428025.993310:0:17909:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc8e00 x1876350940128768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428025.993341:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789428025.993503:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.993509:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428025.993511:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428025.993514:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789428025.994512:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940128768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428025.994689:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.994755:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128768 00000100:00100000:3.0:1789428025.994763:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128768 00000100:00100000:3.0:1789428025.994814:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428025.994823:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940128768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789428025.994854:0:17161:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:3.0:1789428025.994903:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x84fc867ede5195e6 00000004:00100000:3.0:1789428025.994919:0:17161:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789428025.994951:0:17161:0:(import.c:65:import_set_state_nolock()) ffff91968382e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428025.995002:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3612:x1876350940128768:12345-0@lo:38:llog_process_th.0 Request processed in 178us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428025.995009:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789428025.995153:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff919583fc8e00 x1876350940128768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428025.995164:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428025.995179:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789428025.995186:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789428025.995191:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789428025.995194:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428025.995200:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940128768:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789428025.997621:0:17909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789428025.997893:0:17890:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789428025.997924:0:17890:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789428025.997941:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.997953:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789428025.998003:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789428025.998006:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789428025.998007:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428025.998008:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428025.998009:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428025.998011:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428025.998012:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428025.998017:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428025.998018:0:17890:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789428025.998021:0:17890:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789428025.998023:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789428025.998024:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789428025.998025:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428025.998026:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428025.998027:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428025.998027:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428025.998028:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428025.998029:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428025.998030:0:17890:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789428025.998057:0:17890:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789428025.998078:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789428025.998145:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428025.998183:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196989299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428025.998204:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940128896 00000100:00100000:1.0:1789428025.998212:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940128896 00000100:00100000:1.0:1789428025.998253:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789428025.998261:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428025.998285:0:17152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789428025.998297:0:17152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789428025.999678:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789428025.999708:0:17152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789428025.999717:0:17152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789428025.999762:0:17175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789428025.999766:0:17175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789428025.999800:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.999818:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194ea expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.999826:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195ae expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.999838:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.999873:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428025.999888:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 18 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428025.999900:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940129024:0@lo:104: 00000100:00100000:1.0:1789428025.999955:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428025.999997:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000005:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 18 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428026.000013:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940129152:0@lo:104: 00000100:00100000:1.0:1789428026.000033:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.000061:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698929600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428026.000110:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129024 00000100:00100000:1.0:1789428026.000117:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129024 00000100:00100000:1.0:1789428026.000148:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129152 00000100:00100000:1.0:1789428026.000151:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129152 00000100:00100000:1.0:1789428026.000164:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428026.000171:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940129024:12345-0@lo:104: 00010000:00010000:1.0:1789428026.000184:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000241:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789428026.000247:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940129024:12345-0@lo:104: Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428026.000254:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428026.000272:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428026.000279:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940129152:12345-0@lo:104: 00010000:00010000:1.0:1789428026.000286:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000316:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789428026.000321:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940129152:12345-0@lo:104: Request processed in 44us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428026.000326:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428026.000376:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940129024:0@lo:104: 00000100:00100000:1.0:1789428026.000387:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940129152:0@lo:104: 00010000:00010000:1.0:1789428026.000656:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000674:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428026.000680:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000686:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428026.000690:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000698:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428026.000713:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428026.000719:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789428026.000754:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000760:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428026.000791:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000797:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed200/0x84fc867ede5195ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195b5 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000808:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428026.000811:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000816:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428026.000818:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000824:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428026.000829:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428026.000834:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789428026.000854:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000860:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428026.000874:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000881:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ecc00/0x84fc867ede5194ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194f1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428026.000894:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428026.000896:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428026.000897:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428026.000903:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428026.000952:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17890:x1876350940128896:12345-0@lo:253:mount.lustre.0 Request processed in 2691us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428026.000961:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789428026.000996:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940129280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428026.001023:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.001056:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940129408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428026.001076:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.001129:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:17890:1876350940128896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789428026.001139:0:17890:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789428026.001143:0:17890:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789428026.001144:0:17890:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789428026.001146:0:17890:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428026.001147:0:17890:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428026.001148:0:17890:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428026.001149:0:17890:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428026.001151:0:17890:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428026.001158:0:17890:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428026.001160:0:17890:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789428026.001173:0:17890:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789428026.001682:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129280 00000100:00100000:3.0:1789428026.001689:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129280 00010000:00010000:3.0:1789428026.001713:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 18 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428026.001734:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129408 00000100:00100000:3.0:1789428026.001737:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129408 00010000:00010000:3.0:1789428026.001747:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 19 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428026.001759:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428026.001765:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3616:x1876350940129280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428026.001789:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428026.001794:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 19 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.001806:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 19 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.001819:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375cc00/0x84fc867ede5195b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5195ae expref: 19 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.001832:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428026.002043:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3616:x1876350940129280:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428026.002056:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428026.002072:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428026.002077:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:3613:x1876350940129408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428026.002085:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428026.002090:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 17 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002099:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 17 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002109:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375de00/0x84fc867ede5194f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5194ea expref: 17 pid: 17153 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002120:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002128:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789428026.002141:0:17145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003029756s 00010000:00010000:3.0:1789428026.002145:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002152:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002159:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002166:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002176:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428026.002180:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002188:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002203:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428026.002213:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428026.002239:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:3613:x1876350940129408:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428026.002245:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789428026.002518:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940129280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428026.005480:0:17175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428026.005496:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428026.005502:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46a00/0x84fc867ede5195ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428026.007006:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940129408:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789428026.011121:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789428026.011204:0:17915:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789428026.011207:0:17915:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789428026.011485:0:17916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789428026.011499:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789428026.012140:0:17916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428026.014141:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129536:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789428026.014175:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789428026.014212:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428026.014220:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1789428026.015029:0:17890:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789428026.015038:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789428026.015077:0:17916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1789428026.015086:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789428026.015145:0:17916:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789428026.015461:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28cc0 going to sleep for 11 seconds 00000040:00080000:0.0:1789428026.015992:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1789428026.016033:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129536 00000100:00100000:3.0:1789428026.016042:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129536 00000100:00100000:3.0:1789428026.016088:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789428026.016098:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428026.016200:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428026.016207:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428026.016279:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129536:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789428026.016309:0:17917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789428026.016343:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428026.016377:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.016396:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428026.016412:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129664 00000100:00100000:2.0:1789428026.016458:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129664 00000040:00080000:0.0:1789428026.016565:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789428026.016595:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789428026.016680:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428026.017212:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428026.017221:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129664:12345-0@lo:1000:lod0001_rec0000.0 00080000:10000000:0.0:1789428026.017236:0:17890:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1789428026.017473:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 252us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428026.017480:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428026.017531:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428026.017803:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17917:1876350940129792:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789428026.017836:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.017862:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428026.017924:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129792 00000100:00100000:2.0:1789428026.017931:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129792 00000100:00100000:2.0:1789428026.017963:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428026.017971:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1876350940129792:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789428026.018017:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1876350940129792:12345-0@lo:900:lod0001_rec0000.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428026.018025:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789428026.018036:0:17917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9196bf9fbb80 x1876350940129792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428042 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428026.018045:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17917:1876350940129792:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789428026.018084:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428026.018110:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428026.018140:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428026.018156:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940129920 00000100:00100000:3.0:1789428026.018165:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940129920 00000100:00100000:3.0:1789428026.018196:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428026.018202:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428026.018252:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17917:x1876350940129920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428026.018260:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428026.018264:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1876350940129920:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789428026.018299:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1789428026.019949:0:17890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1789428026.020835:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789428026.020898:0:17917:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789428026.020904:0:17917:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1789428026.025949:0:17890:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789428026.025981:0:17890:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb489c1c57988 00100000:10000000:0.0:1789428026.025988:0:17890:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789428026.026370:0:17890:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789428026.026439:0:17890:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789428026.026462:0:17890:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789428026.026480:0:17890:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789428026.027230:0:17890:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428026.027451:0:17890:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428026.097610:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428026.416509:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000040:00080000:0.0:1789428026.418137:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789428027.064674:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789428027.123315:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428027.440648:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 10000000:01000000:3.0:1789428027.568608:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789428027.568617:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919698b0d800 from 8 10000000:01000000:3.0:1789428027.568623:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428027.568669:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.568682:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.568694:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428027.568719:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428027.568809:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428027.568909:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428027.569064:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130048 00000100:00100000:1.0:1789428027.569073:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130048 00000100:00100000:1.0:1789428027.569133:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789428027.569143:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17156:x1876350940130048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428027.569156:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428027.569732:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5195f4 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428027.569836:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428027.569850:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428027.569860:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46e00, rc 0) 00000100:00100000:1.0:1789428027.569961:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940130048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 818us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428027.569969:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789428027.570049:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428027.570065:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.570074:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428027.570178:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789428027.575884:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428027.576008:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428027.576336:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130176 00000100:00100000:1.0:1789428027.576359:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130176 00000100:00100000:3.0:1789428027.576652:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789428027.576664:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940130176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789428027.576695:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789428027.576721:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789428027.576724:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789428027.576881:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940130176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 220us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428027.576890:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789428027.576949:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789428027.577001:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428027.577011:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577023:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428027.577033:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789428027.577036:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bfad4800 from 8 10000000:01000000:3.0:1789428027.577039:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428027.577069:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577091:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577102:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428027.577128:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428027.577160:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428027.577186:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789428027.577201:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130304 00000100:00100000:3.0:1789428027.577206:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130304 00000100:00100000:3.0:1789428027.577228:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789428027.577234:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940130304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428027.577243:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428027.577269:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519602 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577293:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519602 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577305:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519602 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577315:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813eca00, rc 0) 00000100:00100000:3.0:1789428027.577353:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940130304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428027.577359:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789428027.577392:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428027.577404:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.577435:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428027.577828:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789428027.577863:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428027.577877:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789428027.577890:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130432 00000100:00100000:3.0:1789428027.577895:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130432 00000100:00100000:3.0:1789428027.577921:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789428027.577928:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940130432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789428027.577942:0:17153:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789428027.577957:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789428027.577961:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789428027.578026:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940130432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428027.578032:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789428027.578066:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940130432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789428027.578114:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428027.578121:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428027.578130:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428028.083746:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789428028.144587:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428028.464533:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00010000:00010000:1.0:1789428029.168674:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789428029.288921:0:18159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789428029.489827:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000020:00000004:3.0:1789428030.033176:0:18211:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789428030.033391:0:18211:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428030.196868:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428030.512501:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 0 seconds 00000020:00000004:1.0:1789428030.767953:0:18262:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428030.768153:0:18262:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789428031.216967:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428031.281082:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428031.281105:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940130560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428031.281176:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428031.281283:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130560 00000100:00100000:3.0:1789428031.281291:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130560 00000100:00100000:3.0:1789428031.281347:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789428031.281356:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940130560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428031.281404:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428031.281476:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940130560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.281484:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789428031.281526:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940130560:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789428031.288895:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789428031.288903:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789428031.288907:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428031.288923:0:16602:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196905eb000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428031.288949:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fcb480 x1876350940130816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428031.288967:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428031.288970:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428031.288973:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428031.288975:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428031.288986:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428031.288989:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428031.288992:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428031.289009:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789428031.289044:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940131072:0@lo:400:kworker.0 00000100:00100000:0.0:1789428031.289111:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428031.289205:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131072 00000100:00100000:0.0:1789428031.289213:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131072 00000100:00100000:0.0:1789428031.289258:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789428031.289267:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940131072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428031.289316:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940131072:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428031.289323:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789428031.289363:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919583fc9c00 x1876350940131072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428031.289376:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940131072:0@lo:400:kworker.0 00000100:00100000:2.0:1789428031.289568:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940130944:0@lo:400:kworker.0 00000100:00100000:2.0:1789428031.289604:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428031.289635:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789428031.289640:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940130688:0@lo:400:kworker.0 00000100:00100000:2.0:1789428031.289675:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428031.289893:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130944 00000100:00100000:0.0:1789428031.289898:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130944 00000100:00100000:0.0:1789428031.289932:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428031.289939:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940130944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428031.289977:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940130944:12345-0@lo:400:kworker.0 Request processed in 38us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428031.289983:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789428031.290008:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919583fc8380 x1876350940130944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428031.290018:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940130944:0@lo:400:kworker.0 00000100:00100000:3.0:1789428031.290102:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940130816:0@lo:38:kworker.0 00000100:00100000:3.0:1789428031.290134:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428031.290181:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130688 00000100:00100000:3.0:1789428031.290185:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130688 00000100:00100000:3.0:1789428031.290214:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789428031.290220:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3616:x1876350940130688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428031.290253:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3616:x1876350940130688:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.290259:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789428031.290372:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940130816 00000100:00100000:0.0:1789428031.290385:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940130816 00000100:00100000:0.0:1789428031.290593:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428031.290600:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940130816:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789428031.290624:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:0.0:1789428031.290657:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519610 00000004:00100000:0.0:1789428031.290751:0:17164:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789428031.290757:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789428031.290908:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940130688:0@lo:400:kworker.0 00000100:00080000:1.0:1789428031.296750:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9196ade16000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428031.296863:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940130816:12345-0@lo:38:kworker.0 Request processed in 6261us (6725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428031.296875:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789428031.297007:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789428031.297016:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789428031.297022:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789428031.297025:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789428031.297049:0:3612:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b7577a0): req@ffff9195831bed80 x1876350940123776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428031.297071:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940130816:0@lo:38:kworker.0 00000100:00100000:3.0:1789428031.297133:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428031.297163:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834adb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428031.297411:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940123776 00000100:00100000:1.0:1789428031.297439:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940123776 00000100:00100000:1.0:1789428031.297473:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428031.297480:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1876350940123776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428031.297546:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1876350940123776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 66us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428031.297553:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428031.297588:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1876350940123776:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789428031.297618:0:17200:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789428031.297651:0:17200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1876350940131328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428031.297694:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428031.297718:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff919683f1dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428031.297728:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428031.297746:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940131200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428031.297767:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428031.297785:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131328 00000100:00100000:1.0:1789428031.297880:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131328 00000100:00100000:1.0:1789428031.297906:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131200 00000100:00100000:1.0:1789428031.297919:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131200 00000100:00100000:1.0:1789428031.297932:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428031.297938:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17200:x1876350940131328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428031.298017:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17200:x1876350940131328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428031.298023:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428031.298035:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428031.298039:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940131200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789428031.298056:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428031.298085:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940131200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428031.298091:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428031.298118:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1876350940131328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428031.298306:0:17200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1876350940131456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428031.298329:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428031.298378:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff919683f1dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428031.298399:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940131200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789428031.303005:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131456 00000100:00100000:3.0:1789428031.303024:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131456 00000100:00100000:3.0:1789428031.303107:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428031.303117:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1876350940131456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789428031.303264:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1876350940131456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 149us (4933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.303273:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428031.303331:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1876350940131456:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789428031.303394:0:17200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428031.312070:0:17200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789428031.312159:0:17200:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1789428031.312165:0:17200:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000080:3.0:1789428031.702657:0:18310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd9e45930 20000000:00000080:3.0:1789428031.702674:0:18310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196bd616c00 uarg=0000000000000000 20000000:01000000:3.0:1789428031.702704:0:18310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789428031.702710:0:18310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789428031.702714:0:18310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789428031.703647:0:18311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789428031.703867:0:18310:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789428031.708962:0:18310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789428031.708992:0:18310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709011:0:18310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709019:0:18310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195bc expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709027:0:18310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709068:0:18310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709082:0:18310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 17 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.709097:0:18310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18310:1876350940131584:0@lo:104: 00000100:00100000:0.0:1789428031.709168:0:18310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428031.709220:0:18310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.709294:0:18310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.709304:0:18310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18310:1876350940131712:0@lo:104: 00000100:00100000:0.0:1789428031.709324:0:18310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428031.709383:0:18310:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428031.711748:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131584 00000100:00100000:3.0:1789428031.711762:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131584 00000100:00100000:3.0:1789428031.711851:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131712 00000100:00100000:3.0:1789428031.711855:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131712 00000100:00100000:3.0:1789428031.711872:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428031.711881:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:18310:x1876350940131584:12345-0@lo:104: 00010000:00010000:3.0:1789428031.711896:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.712026:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789428031.712033:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:18310:x1876350940131584:12345-0@lo:104: Request processed in 153us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.712050:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428031.712071:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428031.712076:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:18310:x1876350940131712:12345-0@lo:104: 00010000:00010000:3.0:1789428031.712084:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.712159:0:18310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18310:1876350940131584:0@lo:104: 00000100:00100000:0.0:1789428031.712168:0:18310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18310:1876350940131712:0@lo:104: 00010000:00010000:0.0:1789428031.712192:0:18310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712285:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428031.712292:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712309:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428031.712313:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712322:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428031.712330:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428031.712335:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428031.712402:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712409:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428031.712448:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712455:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ede00/0x84fc867ede5195bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195c3 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712468:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428031.712471:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712477:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ece00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428031.712479:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712496:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428031.712574:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428031.712579:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789428031.712637:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789428031.712643:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:18310:x1876350940131712:12345-0@lo:104: Request processed in 567us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.712650:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789428031.712762:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428031.712922:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712930:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428031.712937:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712943:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede5194b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5194c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.712956:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428031.712958:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428031.712960:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428031.712971:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940131840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.713008:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428031.713046:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428031.713051:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940131968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.713068:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428031.713128:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131840 00000100:00100000:3.0:1789428031.713134:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131840 00010000:00010000:3.0:1789428031.713154:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 18 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428031.713180:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940131968 00000100:00100000:3.0:1789428031.713183:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940131968 00010000:00010000:3.0:1789428031.713192:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 19 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428031.713203:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428031.713210:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3615:x1876350940131840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428031.713221:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428031.713235:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 19 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713246:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 19 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713271:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47400/0x84fc867ede5195c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5195bc expref: 19 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713283:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428031.713312:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3615:x1876350940131840:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.713319:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428031.713331:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428031.713337:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:3615:x1876350940131968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428031.713356:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428031.713361:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713369:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713379:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1f400/0x84fc867ede5194c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5194b9 expref: 17 pid: 17151 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713391:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713399:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713441:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713451:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713463:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713470:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713476:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428031.713480:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713488:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713518:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428031.713529:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789428031.713549:0:18310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428031.713552:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:3615:x1876350940131968:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428031.713558:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789428031.713559:0:18310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428031.713565:0:18310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1fe00/0x84fc867ede519617 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428031.713814:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940131968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.713823:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940131840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428032.241651:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428033.265668:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789428033.722828:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789428033.722837:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919698b0d800 from 13 10000000:01000000:3.0:1789428033.722842:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789428033.722904:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.722919:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.723035:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428033.723089:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.723464:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428033.723518:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a04b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789428033.724057:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132096 00000100:00100000:0.0:1789428033.724069:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132096 00000100:00100000:0.0:1789428033.724203:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789428033.724216:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+16:17156:x1876350940132096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428033.724233:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428033.724255:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51961e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.724285:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51961e expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.724297:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51961e expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.724318:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e400, rc 0) 00000100:00100000:0.0:1789428033.724376:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428033.724383:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789428033.724462:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428033.724481:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.724492:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428033.725400:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.725513:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.725588:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789428033.725785:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132224 00000100:00100000:3.0:1789428033.725793:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132224 00000100:00100000:3.0:1789428033.725863:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789428033.725875:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.726042:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.726051:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789428033.726512:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.726622:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.726670:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.726695:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789428033.726719:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132352 00000100:00100000:0.0:1789428033.726725:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132352 00000100:00100000:0.0:1789428033.726753:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789428033.726760:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.726867:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428033.726886:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789428033.726931:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789428033.727964:0:18424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789428033.728037:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789428033.728061:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428033.728074:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.728088:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428033.728100:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428033.728103:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bfad4800 from 13 10000000:01000000:0.0:1789428033.728106:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428033.728277:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.728288:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.728300:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428033.728320:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.728371:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.728471:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428033.728677:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132480 00000100:00100000:3.0:1789428033.728686:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132480 00000100:00100000:3.0:1789428033.728751:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789428033.728764:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+17:17156:x1876350940132480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428033.728778:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428033.728793:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51962c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.728821:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51962c expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.728833:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51962c expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.728843:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813edc00, rc 0) 00000100:00100000:3.0:1789428033.728893:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940132480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.728909:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789428033.729517:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428033.729538:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.729550:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428033.729740:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.729785:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428033.729831:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a04b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789428033.729853:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132608 00000100:00100000:3.0:1789428033.729858:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132608 00000100:00100000:3.0:1789428033.729895:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789428033.729904:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940132608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.730048:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940132608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.730058:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789428033.730108:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.730157:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.730203:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428033.730220:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1789428033.730242:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132736 00000100:00100000:3.0:1789428033.730245:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132736 00000100:00100000:3.0:1789428033.730276:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428033.730292:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940132736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.730384:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:17156:x1876350940132736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.730394:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428033.730473:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940132736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789428033.735247:0:18425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789428033.735504:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789428033.735542:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428033.735563:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.735577:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428034.290671:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428035.315767:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428035.381652:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428025/real 1789428025] req@ffff9195831be300 x1876350940126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428035.381700:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831be300 x1876350940126976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428035.381714:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428025/real 1789428025] req@ffff9195831bdc00 x1876350940126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428035.381727:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831bdc00 x1876350940126848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789428035.381821:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428035.381847:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428035.381852:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126976:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789428035.381859:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428035.381865:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428035.381868:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940126848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789428035.382019:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428035.382024:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428035.382027:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428035.382030:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428035.382058:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428035.382062:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789428035.382066:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428035.382072:0:16602:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 370 00000100:00080000:2.0:1789428035.382079:0:16602:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428035.382092:0:16602:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196b5aab000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428035.382116:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831be300 x1876350940133376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428035.382129:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428035.382133:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428035.382135:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428035.382139:0:16602:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 370 00000100:00080000:2.0:1789428035.382141:0:16602:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428035.382146:0:16602:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9196b5b0e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428035.382157:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bed80 x1876350940133504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428035.382192:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940133120:0@lo:400:kworker.0 00000100:00100000:2.0:1789428035.382278:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428035.382334:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428035.382340:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940133248:0@lo:400:kworker.0 00000100:00100000:2.0:1789428035.382370:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428035.382444:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940133120 00000100:00100000:2.0:1789428035.382453:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940133120 00000100:00100000:2.0:1789428035.382513:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428035.382524:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940133120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428035.382581:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940133120:12345-0@lo:400:kworker.0 Request processed in 58us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.382588:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428035.382614:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940133248 00000100:00100000:2.0:1789428035.382618:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940133248 00000100:00100000:2.0:1789428035.382641:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428035.382648:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428035.382682:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940133248:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.382689:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428035.382740:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940133248:0@lo:400:kworker.0 00010000:00080000:2.0:1789428035.382762:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9195831bca80 x1876350940133120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428035.382771:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940133120:0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.382900:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940132864:0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.382939:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428035.382986:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940133632:0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.383010:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428035.383030:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428035.383035:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940132992:0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.383056:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428035.383086:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132992 00000100:00100000:3.0:1789428035.383090:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132992 00000100:00100000:3.0:1789428035.383116:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428035.383122:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.383157:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940132992:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428035.383163:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428035.383181:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940133632 00000100:00100000:3.0:1789428035.383184:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940133632 00000100:00100000:3.0:1789428035.383206:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428035.383212:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940133632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.383239:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940133632:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428035.383244:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428035.383272:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940132992:0@lo:400:kworker.0 00010000:00080000:3.0:1789428035.383281:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9195831bd180 x1876350940133632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428035.383288:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940133632:0@lo:400:kworker.0 00000100:00100000:3.0:1789428035.383305:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940133376:0@lo:8:kworker.0 00000400:00000100:3.0:1789428035.383323:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940133376 offset 0 length 520: 4 00000100:00100000:3.0:1789428035.383344:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940133504:0@lo:8:kworker.0 00000400:00000100:3.0:1789428035.383358:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940133504 offset 0 length 520: 4 00000100:00100000:2.0:1789428035.383453:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940132864 00000100:00100000:2.0:1789428035.383458:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940132864 00000100:00100000:2.0:1789428035.383484:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789428035.383491:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3613:x1876350940132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428035.383525:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:3613:x1876350940132864:12345-0@lo:400:kworker.0 Request processed in 35us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.383537:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789428035.383620:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940132864:0@lo:400:kworker.0 00010000:00010000:0.0:1789428036.343768:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428036.400951:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428036.400983:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940133760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428036.401081:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428036.401144:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940133760 00000100:00100000:1.0:1789428036.401154:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940133760 00000100:00100000:1.0:1789428036.401213:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789428036.401223:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940133760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789428036.401296:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428036.401357:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940133760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428036.401365:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789428036.401450:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940133760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428036.409760:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428036.411853:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940133888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428036.411977:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428036.415756:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940133888 00000100:00100000:3.0:1789428036.415777:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940133888 00000100:00100000:3.0:1789428036.415844:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428036.415856:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940133888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428036.415906:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428036.416028:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940133888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.416035:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428036.416140:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940133888:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789428036.658245:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789428037.364295:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789428037.417688:0:18658:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789428037.417693:0:18658:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789428037.417694:0:18658:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789428037.417967:0:18658:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196b5b09800 00000020:01000004:2.0:1789428037.417987:0:18658:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789428037.418001:0:18658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789428037.418015:0:18658:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff919688453380) 00000020:00000080:2.0:1789428037.418033:0:18658:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000001:00100000:0.0:1789428037.431084:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00100000:10000000:3.0:1789428037.466995:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789428037.469546:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789428037.469742:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789428037.469976:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789428037.470220:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789428037.470393:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789428037.470573:0:18658:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789428037.471193:0:18658:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789428037.471372:0:18658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789428037.471383:0:18658:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789428037.471392:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede519641 00000020:01000004:3.0:1789428037.471397:0:18658:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789428037.471452:0:18658:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789428037.471455:0:18658:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789428037.471460:0:18658:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789428037.471463:0:18658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789428037.471476:0:18658:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9196bbde4d40) 00000020:00000080:3.0:1789428037.471484:0:18658:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789428037.473634:0:18658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789428037.473949:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789428037.473955:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789428037.474594:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789428037.474602:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789428037.475017:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789428037.475025:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789428037.477191:0:18658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428037.477367:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789428037.477374:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789428037.478116:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789428037.478123:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789428037.501048:0:18658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428037.501278:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789428037.501284:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789428037.502954:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789428037.502967:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789428037.504131:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789428037.504140:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789428037.506611:0:18658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789428037.506944:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789428037.506951:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789428037.507542:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789428037.507548:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789428037.539223:0:18658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789428037.539544:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789428037.539552:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789428037.540640:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789428037.540649:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789428037.541144:0:18658:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789428037.541169:0:18658:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789428037.541176:0:18658:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789428037.548307:0:18658:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789428037.548349:0:18658:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789428037.548355:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789428037.548357:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.548358:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.548360:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.548361:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.548362:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.548364:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.548365:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.548367:0:18658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428037.548376:0:18658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789428037.548378:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428037.548379:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.548380:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.548381:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.548382:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.548383:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.548384:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.548385:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.548387:0:18658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428037.548411:0:18658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789428037.548550:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428037.548637:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.548748:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.548887:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134016 00000100:00100000:0.0:1789428037.548895:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134016 00000100:00100000:0.0:1789428037.548998:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789428037.549009:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:18658:x1876350940134016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789428037.549042:0:17152:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789428037.549045:0:17152:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789428037.549049:0:17152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789428037.549333:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:18658:x1876350940134016:12345-0@lo:253:mount.lustre.0 Request processed in 325us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.549341:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789428037.549449:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789428037.549459:0:18658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789428037.549461:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789428037.549462:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.549463:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.549464:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.549465:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.549466:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.549467:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.549468:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.549469:0:18658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789428037.549485:0:18658:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196b5b09800 from lustre-OST0000 10000000:01000000:3.0:1789428037.549513:0:18658:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789428037.549515:0:18658:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789428037.549522:0:18658:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91958302b380 local copy 00010000:00010000:3.0:1789428037.549531:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.549612:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.549640:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.549966:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.550028:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134144 00000100:00100000:2.0:1789428037.550034:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134144 00000100:00100000:2.0:1789428037.550060:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789428037.550066:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:18658:x1876350940134144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428037.550140:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:18658:x1876350940134144:12345-0@lo:501:mount.lustre.0 Request processed in 73us (499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789428037.550147:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789428037.550243:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134144:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789428037.550256:0:18658:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789428037.550275:0:18658:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789428037.550281:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.550290:0:18658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428037.550316:0:18658:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196b5b09800 10000000:01000000:3.0:1789428037.550321:0:18658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789428037.550325:0:18658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789428037.550328:0:18658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789428037.550333:0:18658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789428037.550335:0:18658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789428037.550356:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.550363:0:18658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.550372:0:18658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.550383:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428037.550408:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.550521:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.550567:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134272 00000100:00100000:1.0:1789428037.550572:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134272 00000100:00100000:2.0:1789428037.550612:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789428037.550619:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+18:18658:x1876350940134272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428037.550636:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428037.550649:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375c000/0x84fc867ede519656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51964f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.550681:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375c000/0x84fc867ede519656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51964f expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.550693:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375c000/0x84fc867ede519656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51964f expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.550701:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375c000, rc 0) 00000100:00100000:2.0:1789428037.550887:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134272:12345-0@lo:101:mount.lustre.0 Request processed in 268us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.550894:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789428037.551012:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428037.551030:0:18658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.551038:0:18658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428037.555093:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789428037.555655:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428037.557973:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789428037.558042:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789428037.558060:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789428037.558074:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789428037.558088:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789428037.558101:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789428037.558126:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789428037.558132:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789428037.558236:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.558306:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.558358:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.558584:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134400 00000100:00100000:2.0:1789428037.558593:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134400 00000100:00100000:2.0:1789428037.558645:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789428037.558655:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428037.559094:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134400:12345-0@lo:501:mount.lustre.0 Request processed in 440us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.559102:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789428037.559173:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.559206:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428037.559242:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.559312:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.559340:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134528 00000100:00100000:0.0:1789428037.559345:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134528 00000100:00100000:0.0:1789428037.559440:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789428037.559449:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428037.560251:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134528:12345-0@lo:503:mount.lustre.0 Request processed in 801us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.560266:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789428037.560337:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428037.560776:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428037.560854:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.560898:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428037.561256:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134656 00000100:00100000:1.0:1789428037.561263:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134656 00000100:00100000:1.0:1789428037.561292:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789428037.561299:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.561514:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.561736:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134656:12345-0@lo:502:mount.lustre.0 Request processed in 428us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.561744:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789428037.561977:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428037.562168:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789428037.562196:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789428037.562209:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789428037.562222:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789428037.562236:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789428037.562249:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789428037.562262:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789428037.562275:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789428037.562305:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789428037.562320:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789428037.562335:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789428037.562349:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789428037.562374:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.562411:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.562468:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.562580:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134784 00000100:00100000:1.0:1789428037.562584:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134784 00000100:00100000:1.0:1789428037.562616:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789428037.562630:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428037.562723:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134784:12345-0@lo:502:mount.lustre.0 Request processed in 94us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.562917:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428037.562956:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789428037.562964:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000100:00100000:1.0:1789428037.563407:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:3.0:1789428037.563642:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789428037.563650:0:18676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789428037.563656:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428037.563658:0:18676:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789428037.563663:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428037.563687:0:18676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9196bbde0000) 00000020:00000080:3.0:1789428037.563709:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789428037.563715:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789428037.563919:0:18676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196b5b09800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789428037.563927:0:18676:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789428037.563947:0:18676:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede519664 00010000:00010000:3.0:1789428037.568167:0:18676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789428037.568714:0:18676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789428037.570054:0:18676:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789428037.571599:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789428037.571611:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428037.571618:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571621:0:18676:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789428037.571624:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789428037.571627:0:18676:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789428037.571629:0:18676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428037.571631:0:18676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428037.571639:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428037.571642:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571644:0:18676:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428037.571646:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428037.571649:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571651:0:18676:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789428037.571654:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789428037.571656:0:18676:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789428037.571659:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428037.571661:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571662:0:18676:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789428037.571665:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428037.571667:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571669:0:18676:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789428037.571683:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789428037.571711:0:18676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428037.571714:0:18676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428037.571716:0:18676:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789428037.571719:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789428037.572147:0:18658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789428037.572178:0:18658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789428037.572241:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.572254:0:18658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428037.572263:0:18658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196b5b09800 from 1 10000000:01000000:0.0:1789428037.572266:0:18658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428037.572303:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.572311:0:18658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.572322:0:18658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.572347:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428037.572440:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.572478:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.573955:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940134912 00000100:00100000:2.0:1789428037.573967:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940134912 00000100:00100000:2.0:1789428037.574019:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789428037.574029:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:18658:x1876350940134912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428037.574044:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428037.574061:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51966b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.574087:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51966b expref: 20 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.574097:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51966b expref: 20 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.574126:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375dc00, rc 0) 00000100:00100000:2.0:1789428037.574184:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940134912:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.574191:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789428037.574299:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940134912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428037.574316:0:18658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.574325:0:18658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428037.575894:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789428037.576165:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428037.576340:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789428037.576361:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789428037.576375:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789428037.576380:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789428037.577937:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428037.578007:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.578048:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968570db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.578514:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135040 00000100:00100000:1.0:1789428037.578523:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135040 00000100:00100000:1.0:1789428037.578575:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789428037.578586:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428037.578743:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135040:12345-0@lo:501:mount.lustre.0 Request processed in 159us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.578751:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789428037.578991:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428037.579031:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428037.579074:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.579104:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.579155:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135168 00000100:00100000:2.0:1789428037.579160:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135168 00000100:00100000:2.0:1789428037.579229:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789428037.579237:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428037.579322:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135168:12345-0@lo:503:mount.lustre.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.579330:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789428037.581214:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135168:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428037.581732:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428037.581889:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428037.581962:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.584895:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.585053:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135296 00000100:00100000:1.0:1789428037.585063:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135296 00000100:00100000:1.0:1789428037.585110:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789428037.585120:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428037.585286:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135296:12345-0@lo:502:mount.lustre.0 Request processed in 167us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.585294:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428037.585399:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428037.585700:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789428037.585742:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789428037.585759:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789428037.585772:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789428037.585784:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789428037.585931:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789428037.585950:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789428037.585965:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789428037.585977:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789428037.585988:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789428037.586000:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789428037.586031:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428037.586075:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.586096:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.586153:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135424 00000100:00100000:2.0:1789428037.586160:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135424 00000100:00100000:2.0:1789428037.586190:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789428037.586198:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428037.586286:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135424:12345-0@lo:502:mount.lustre.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.586302:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789428037.586507:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428037.586552:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789428037.586560:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789428037.587391:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428037.587402:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.587405:0:18680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789428037.587525:0:18680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196b5b09800 00000020:00000080:0.0:1789428037.587528:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428037.587535:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428037.587538:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.587539:0:18680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789428037.587544:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428037.587546:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.587547:0:18680:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789428037.587550:0:18680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196b5b09800 00000020:00000080:0.0:1789428037.587552:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428037.587636:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428037.587639:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.587641:0:18680:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789428037.587645:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428037.587648:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.587649:0:18680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428037.587653:0:18680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196b5b09800 00000020:00000080:0.0:1789428037.587655:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428037.591853:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428037.591868:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.591870:0:18680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428037.591886:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428037.591891:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.591893:0:18680:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789428037.591898:0:18680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196b5b09800 00000020:00000080:0.0:1789428037.591901:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428037.591962:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428037.591972:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428037.591973:0:18680:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789428037.591979:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789428037.592247:0:18658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789428037.592278:0:18658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789428037.592303:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.592315:0:18658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428037.592371:0:18658:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789428037.592374:0:18658:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196b5b09800 10000000:01000000:3.0:1789428037.592376:0:18658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196b5b09800 10000000:01000000:3.0:1789428037.592380:0:18658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789428037.592384:0:18658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196b5b09800 from 1 10000000:01000000:3.0:1789428037.592387:0:18658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789428037.592439:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.592448:0:18658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.592458:0:18658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.592483:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428037.592552:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.592589:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428037.593531:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135552 00000100:00100000:3.0:1789428037.593539:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135552 00000100:00100000:3.0:1789428037.593593:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789428037.593602:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:18658:x1876350940135552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428037.593617:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428037.593630:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ede00/0x84fc867ede519680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519679 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.593653:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ede00/0x84fc867ede519680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519679 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.593664:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ede00/0x84fc867ede519680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519679 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.593683:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ede00, rc 0) 00000100:00100000:3.0:1789428037.593741:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135552:12345-0@lo:101:mount.lustre.0 Request processed in 131us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.593748:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789428037.594169:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428037.594187:0:18658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.594198:0:18658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428037.595514:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789428037.596585:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428037.597916:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789428037.597956:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789428037.597981:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789428037.597995:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789428037.598023:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789428037.598040:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789428037.598054:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789428037.598068:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789428037.598082:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789428037.598097:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789428037.598111:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789428037.598122:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789428037.598135:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789428037.598148:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789428037.598161:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789428037.598174:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789428037.598188:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789428037.598202:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789428037.598216:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789428037.598230:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789428037.598258:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789428037.598274:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789428037.598289:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789428037.598303:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789428037.598318:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789428037.598331:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789428037.598343:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789428037.598355:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789428037.598368:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789428037.598383:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789428037.598396:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789428037.598409:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789428037.598490:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789428037.598507:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789428037.598520:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789428037.598542:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789428037.598568:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789428037.598596:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789428037.598602:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789428037.598723:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.598797:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.598836:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135680 00000100:00100000:3.0:1789428037.598843:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135680 00000100:00100000:3.0:1789428037.598885:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789428037.598894:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.599006:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135680:12345-0@lo:501:mount.lustre.0 Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.599014:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789428037.599056:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428037.599076:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428037.599103:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428037.599137:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.599152:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.603763:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135808 00000100:00100000:0.0:1789428037.603784:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135808 00000100:00100000:0.0:1789428037.603858:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789428037.603868:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428037.604043:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135808:12345-0@lo:503:mount.lustre.0 Request processed in 176us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.604051:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789428037.606254:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428037.607014:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428037.607198:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.607281:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.607329:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.608848:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940135936 00000100:00100000:0.0:1789428037.608861:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940135936 00000100:00100000:0.0:1789428037.608914:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789428037.608924:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428037.609078:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940135936:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.609086:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789428037.610107:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940135936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428037.610321:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789428037.610359:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789428037.610375:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789428037.610391:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789428037.610406:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789428037.610454:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789428037.610468:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789428037.610481:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789428037.610495:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789428037.610507:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789428037.610520:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789428037.610534:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789428037.610565:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789428037.610581:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789428037.610597:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789428037.610611:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789428037.610625:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789428037.610636:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789428037.610647:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789428037.610660:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789428037.610687:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789428037.610704:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789428037.610717:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789428037.612854:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789428037.612903:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789428037.612920:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789428037.612932:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789428037.612945:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789428037.612975:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789428037.612989:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789428037.613002:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789428037.613014:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789428037.613026:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789428037.613039:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789428037.613064:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789428037.613079:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789428037.613093:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789428037.613107:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789428037.613119:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789428037.613132:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789428037.613146:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789428037.613159:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789428037.613174:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789428037.613185:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789428037.613209:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789428037.613223:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789428037.613235:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789428037.613250:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789428037.613306:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940136064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.613375:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.613437:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.613534:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136064 00000100:00100000:0.0:1789428037.613541:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136064 00000100:00100000:0.0:1789428037.613591:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789428037.613599:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940136064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428037.613711:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940136064:12345-0@lo:502:mount.lustre.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.613719:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789428037.615836:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940136064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428037.616044:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789428037.616070:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789428037.616103:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940136192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428037.616160:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.616195:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf9386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.616271:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136192 00000100:00100000:0.0:1789428037.616278:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136192 00000100:00100000:0.0:1789428037.616322:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789428037.616330:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940136192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428037.616458:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940136192:12345-0@lo:502:mount.lustre.0 Request processed in 127us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.616465:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789428037.616553:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940136192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428037.616589:0:18658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789428037.616597:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789428037.623226:0:18685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789428037.623246:0:18685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff919688890000) 00000020:00000080:0.0:1789428037.623271:0:18685:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789428037.623387:0:18685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196b5b09800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428037.623391:0:18685:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196b5b09800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428037.623393:0:18685:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196b5b09800 3 00010000:00080000:0.0:1789428037.623450:0:18685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919582405000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1789428037.625036:0:18685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789428037.626234:0:18685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789428037.626289:0:18685:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789428037.626304:0:18685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x84fc867ede51968e 00000100:00080000:0.0:1789428037.626316:0:18685:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428037.626328:0:18685:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919582405000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428037.626384:0:18685:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc9500 x1876350940136320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428037.626441:0:18685:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789428037.626762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428037.626767:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428037.626770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428037.626773:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428037.626797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428037.626801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428037.626803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428037.626807:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428037.626843:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940136832:0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.626918:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.626957:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428037.626963:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940136448:0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.626990:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.627021:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940136576:0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627042:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.627060:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428037.627065:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940136704:0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627084:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.627115:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136832 00000100:00100000:2.0:1789428037.627121:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136832 00000100:00100000:2.0:1789428037.627155:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136576 00000100:00100000:2.0:1789428037.627158:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136576 00000100:00100000:2.0:1789428037.627185:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428037.627193:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940136832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627247:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940136832:12345-0@lo:400:kworker.0 Request processed in 53us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.627254:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428037.627271:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428037.627277:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940136576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627307:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940136576:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.627313:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428037.627334:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136448 00000100:00100000:2.0:1789428037.627338:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136448 00000100:00100000:2.0:1789428037.627356:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136704 00000100:00100000:2.0:1789428037.627360:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136704 00000100:00100000:2.0:1789428037.627373:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428037.627380:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940136448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627408:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940136448:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.627433:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428037.627445:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428037.627450:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940136704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627476:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940136704:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.627481:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428037.627524:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940136448:0@lo:400:kworker.0 00010000:00080000:2.0:1789428037.627537:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9195831bc380 x1876350940136832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428037.627555:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940136832:0@lo:400:kworker.0 00000100:00100000:2.0:1789428037.627582:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940136704:0@lo:400:kworker.0 00010000:00080000:2.0:1789428037.627590:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9195831bc000 x1876350940136576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428037.627597:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940136576:0@lo:400:kworker.0 00000100:00100000:1.0:1789428037.629098:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940136320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428037.629168:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1789428037.629441:0:18685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789428037.629458:0:18685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff919688894d40) 00000020:00000080:0.0:1789428037.629484:0:18685:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789428037.629565:0:18685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196b5b09800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428037.629570:0:18685:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196b5b09800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428037.629572:0:18685:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196b5b09800 3 00010000:00080000:0.0:1789428037.629600:0:18685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919582406800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.124@tcp at head 00000100:00100000:2.0:1789428037.631525:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136320 00000100:00100000:2.0:1789428037.631538:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136320 00000100:00100000:2.0:1789428037.631583:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428037.631593:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940136320:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789428037.631621:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:2.0:1789428037.631657:0:17159:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x84fc867ede51969c 00000004:00100000:2.0:1789428037.631684:0:17159:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789428037.631717:0:17159:0:(import.c:65:import_set_state_nolock()) ffff919582435000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428037.631910:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3612:x1876350940136320:12345-0@lo:38:llog_process_th.0 Request processed in 316us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.631917:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789428037.632057:0:18685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789428037.632249:0:18685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789428037.632596:0:18685:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789428037.632606:0:18685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x84fc867ede5196a3 00000100:00080000:0.0:1789428037.632612:0:18685:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428037.632621:0:18685:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff919582406800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428037.632653:0:18685:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc8700 x1876350940136960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428037.632679:0:18685:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789428037.632706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428037.632711:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428037.632714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428037.632716:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428037.632720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428037.632723:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428037.632725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428037.633829:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789428037.636458:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:1.0:1789428037.637698:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919583fc9500 x1876350940136320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428037.637713:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428037.637724:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789428037.637799:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789428037.637811:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789428037.637814:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789428037.637823:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940136320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428037.637857:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940136960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428037.637926:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789428037.638090:0:18658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789428037.638126:0:18658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789428037.638150:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.638170:0:18658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789428037.638220:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789428037.638222:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.638224:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.638226:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.638227:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.638228:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.638230:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.638232:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.638234:0:18658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428037.638238:0:18658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789428037.638240:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428037.638242:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.638243:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.638244:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.638245:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.638246:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.638247:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.638248:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.638250:0:18658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428037.638273:0:18658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789428037.638287:0:18658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940137088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428037.638323:0:18658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.638355:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137088 00000100:00100000:3.0:1789428037.638363:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137088 00000100:00100000:3.0:1789428037.638434:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789428037.638443:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940137088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789428037.638468:0:17151:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789428037.638482:0:17151:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789428037.638602:0:18658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bf938f00 going to sleep for 11 seconds 20000000:01000000:3.0:1789428037.642263:0:17151:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789428037.642295:0:17151:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789428037.642586:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:18658:x1876350940137088:12345-0@lo:253:mount.lustre.0 Request processed in 4138us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.642601:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789428037.642706:0:18658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:18658:1876350940137088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789428037.642721:0:18658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789428037.642725:0:18658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789428037.642736:0:18658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428037.642738:0:18658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428037.642740:0:18658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428037.642742:0:18658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428037.642743:0:18658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428037.642745:0:18658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428037.642747:0:18658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428037.642748:0:18658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789428037.642763:0:18658:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789428037.643563:0:17175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789428037.643568:0:17175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789428037.643590:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643607:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643616:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519602 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643623:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643659:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643685:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 20 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.643699:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940137216:0@lo:104: 00000100:00100000:1.0:1789428037.643754:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428037.643797:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.643818:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.643827:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940137344:0@lo:104: 00000100:00100000:1.0:1789428037.643853:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428037.643872:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.643896:0:17142:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789428037.643907:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137216 00000100:00100000:1.0:1789428037.643914:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137216 00000100:00100000:1.0:1789428037.643942:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137344 00000100:00100000:1.0:1789428037.643945:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137344 00000100:00100000:1.0:1789428037.643958:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428037.643967:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940137216:12345-0@lo:104: 00010000:00010000:1.0:1789428037.643980:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.644024:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789428037.644030:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940137216:12345-0@lo:104: Request processed in 65us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.644036:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428037.644054:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428037.644060:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919687389c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940137344:12345-0@lo:104: 00010000:00010000:1.0:1789428037.644067:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.644099:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789428037.644104:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919687389c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940137344:12345-0@lo:104: Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.644116:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428037.644162:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940137216:0@lo:104: 00000100:00100000:1.0:1789428037.644171:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940137344:0@lo:104: 00010000:00010000:1.0:1789428037.644185:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644488:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428037.644496:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644504:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eda00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428037.644508:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644517:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428037.644531:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428037.644538:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428037.644568:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644575:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428037.644597:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644604:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813eda00/0x84fc867ede519602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519609 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644617:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428037.644620:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644626:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428037.644630:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644637:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428037.644644:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428037.644650:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428037.644668:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644686:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428037.644702:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644708:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec600/0x84fc867ede5195f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5195fb expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.644722:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428037.644723:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428037.644725:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789428037.645560:0:18658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789428037.645819:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428037.645833:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940137472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428037.645883:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.645937:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940137600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428037.645961:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.645996:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137472 00000100:00100000:0.0:1789428037.646003:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137472 00010000:00010000:0.0:1789428037.646026:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 21 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.646053:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137600 00000100:00100000:0.0:1789428037.646056:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137600 00010000:00010000:0.0:1789428037.646067:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 22 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.646080:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428037.646088:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:3616:x1876350940137472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428037.646110:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428037.646115:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 22 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646126:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 22 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646140:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813eca00/0x84fc867ede519609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519602 expref: 22 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646154:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428037.646186:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3616:x1876350940137472:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.646193:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428037.646210:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428037.646216:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:3613:x1876350940137600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428037.646224:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428037.646228:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646237:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646246:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46e00/0x84fc867ede5195fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5195f4 expref: 20 pid: 17153 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646259:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646267:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789428037.646286:0:17146:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003029756s 00010000:00010000:0.0:1789428037.646292:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646299:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646306:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646312:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646318:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428037.646322:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646329:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646343:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646352:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428037.646373:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3613:x1876350940137600:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.646380:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428037.646454:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940137472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428037.646472:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940137600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428037.646494:0:17175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646501:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.646508:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46400/0x84fc867ede5196aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428037.648516:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940136960 00000100:00100000:2.0:1789428037.648531:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940136960 00000100:00100000:2.0:1789428037.648566:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428037.648574:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940136960:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789428037.648604:0:17161:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:2.0:1789428037.648639:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x84fc867ede5196b1 00000004:00100000:2.0:1789428037.648656:0:17161:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789428037.648718:0:17161:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428037.648871:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3612:x1876350940136960:12345-0@lo:38:llog_process_th.0 Request processed in 296us (10944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.648878:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789428037.648960:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919583fc8700 x1876350940136960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428037.648973:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428037.648982:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789428037.648991:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789428037.648995:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789428037.648998:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919582406800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789428037.649004:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940136960:0@lo:38:llog_process_th.0 00002000:00080000:3.0:1789428037.649124:0:18658:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789428037.649130:0:18658:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789428037.649179:0:18658:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789428037.649222:0:18658:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789428037.649242:0:18658:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789428037.649266:0:18658:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789428037.653268:0:18658:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789428037.653496:0:18658:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789428038.322018:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789428038.326077:0:18738:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789428038.326285:0:18738:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789428038.385236:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789428038.960594:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789428038.960610:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919698b0d800 from 9 10000000:01000000:1.0:1789428038.960619:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789428038.960729:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.960745:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.960759:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428038.960796:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428038.960937:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428038.961004:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428038.961140:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137728 00000100:00100000:0.0:1789428038.961151:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137728 00000100:00100000:0.0:1789428038.961230:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789428038.961242:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:17156:x1876350940137728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428038.961260:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428038.961279:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5196b8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.961308:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 20 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.961321:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 20 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.961332:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e000, rc 0) 00000100:00100000:0.0:1789428038.961388:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:17156:x1876350940137728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428038.961396:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789428038.962783:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428038.962816:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.962832:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428038.962931:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789428038.962993:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428038.963042:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428038.963621:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137856 00000100:00100000:3.0:1789428038.963632:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137856 00000100:00100000:3.0:1789428038.963714:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789428038.963726:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:17156:x1876350940137856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789428038.963760:0:17151:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789428038.963923:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789428038.963935:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789428038.964073:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:17156:x1876350940137856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 349us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428038.964083:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789428038.964105:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428038.964192:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428038.964205:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.964366:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428038.964382:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789428038.964386:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bfad4800 from 9 10000000:01000000:1.0:1789428038.964390:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789428038.964458:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.964467:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.964489:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428038.964511:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428038.964548:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428038.964591:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428038.964721:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940137984 00000100:00100000:2.0:1789428038.964730:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940137984 00000100:00100000:2.0:1789428038.964777:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789428038.964788:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:17156:x1876350940137984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428038.964799:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428038.964816:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5196c6 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.964845:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 21 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.964857:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 21 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.964867:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375cc00, rc 0) 00000100:00100000:2.0:1789428038.964910:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940137984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428038.964917:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789428038.964945:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940137984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428038.964961:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.964971:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428038.965017:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940138112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789428038.965048:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428038.965069:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428038.965292:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138112 00000100:00100000:3.0:1789428038.965297:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138112 00000100:00100000:3.0:1789428038.965318:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789428038.965325:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940138112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789428038.965341:0:17151:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789428038.965360:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789428038.965364:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789428038.965495:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940138112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428038.965503:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789428038.969654:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940138112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428038.969826:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428038.969844:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428038.969862:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.409015:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428039.664519:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428024/real 1789428024] req@ffff9196bf9f9500 x1876350940124800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428039 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428039.664572:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bf9f9500 x1876350940124800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428039 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428039.664583:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428024/real 1789428024] req@ffff9196bf9f8380 x1876350940124928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428039 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428039.664595:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bf9f8380 x1876350940124928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428039 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789428039.664620:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428039.664721:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428039.664726:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124800:0@lo:8:kworker.0 00000100:00080000:1.0:1789428039.664733:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428039.669046:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.669074:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789428039.669080:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428039.669090:0:16602:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1789428039.669098:0:16602:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789428039.669114:0:16602:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9196ad917000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428039.669152:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc9880 x1876350940138496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428039.669166:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.669170:0:16602:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428039.669171:0:16602:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428039.669174:0:16602:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1789428039.669177:0:16602:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789428039.669182:0:16602:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428039.669196:0:16602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fc9f80 x1876350940138624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428039.669221:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.669225:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428039.669228:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.669232:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789428039.669289:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940138368:0@lo:400:kworker.0 00000100:00100000:0.0:1789428039.669385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428039.669454:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940139136:0@lo:400:kworker.0 00000100:00100000:0.0:1789428039.669488:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428039.669526:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789428039.669531:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940138752:0@lo:400:kworker.0 00000100:00100000:0.0:1789428039.669555:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428039.669570:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940139264:0@lo:400:kworker.0 00000100:00100000:0.0:1789428039.669593:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428039.669830:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940138880:0@lo:400:kworker.0 00000100:00100000:3.0:1789428039.669866:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428039.669888:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789428039.669894:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940138240:0@lo:400:kworker.0 00000100:00100000:3.0:1789428039.669923:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428039.669955:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940139008:0@lo:400:kworker.0 00000100:00100000:3.0:1789428039.669977:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428039.670126:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138240 00000100:00100000:3.0:1789428039.670136:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138240 00000100:00100000:3.0:1789428039.670193:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789428039.670203:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3613:x1876350940138240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428039.670260:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3613:x1876350940138240:12345-0@lo:400:kworker.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428039.670280:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789428039.670340:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940138240:0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.670845:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138368 00000100:00100000:2.0:1789428039.670852:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138368 00000100:00100000:2.0:1789428039.670889:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138880 00000100:00100000:2.0:1789428039.670893:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138880 00000100:00100000:2.0:1789428039.670910:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428039.670928:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.670991:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940138368:12345-0@lo:400:kworker.0 Request processed in 66us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.670998:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428039.671014:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428039.671020:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671055:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940138880:12345-0@lo:400:kworker.0 Request processed in 35us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.671061:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428039.671088:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139136 00000100:00100000:2.0:1789428039.671092:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139136 00000100:00100000:2.0:1789428039.671124:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138752 00000100:00100000:2.0:1789428039.671127:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138752 00000100:00100000:2.0:1789428039.671140:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139264 00000100:00100000:2.0:1789428039.671143:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139264 00000100:00100000:2.0:1789428039.671157:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139008 00000100:00100000:2.0:1789428039.671159:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139008 00000100:00100000:2.0:1789428039.671173:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428039.671180:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940139136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671213:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940139136:12345-0@lo:400:kworker.0 Request processed in 34us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.671219:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428039.671244:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428039.671251:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940138752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671281:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940138752:12345-0@lo:400:kworker.0 Request processed in 31us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.671287:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428039.671306:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428039.671312:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940139264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671340:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940139264:12345-0@lo:400:kworker.0 Request processed in 29us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.671346:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428039.671356:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428039.671362:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940139008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671390:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940139008:12345-0@lo:400:kworker.0 Request processed in 28us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.671395:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789428039.671474:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789428039.671479:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789428039.671506:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fcb480 x1876350940139008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428039.671523:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940139008:0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671536:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940138880:0@lo:400:kworker.0 00010000:00080000:2.0:1789428039.671583:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc9500 x1876350940138752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428039.671594:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940138752:0@lo:400:kworker.0 00010000:00080000:2.0:1789428039.671612:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc8a80 x1876350940139264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428039.671622:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940139264:0@lo:400:kworker.0 00000100:00100000:2.0:1789428039.671633:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940138368:0@lo:400:kworker.0 00010000:00080000:2.0:1789428039.671676:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc8e00 x1876350940139136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428039.671686:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940139136:0@lo:400:kworker.0 00000100:00080000:1.0:1789428039.672050:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428039.672058:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940124928:0@lo:8:kworker.0 00000100:00100000:1.0:1789428039.672092:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940138496:0@lo:8:kworker.0 00000100:00100000:1.0:1789428039.672145:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428039.672180:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940138624:0@lo:8:kworker.0 00000100:00100000:1.0:1789428039.672211:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789428039.680995:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.681009:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428039.681013:0:16602:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428039.681016:0:16602:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428039.686869:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138496 00000100:00100000:2.0:1789428039.686892:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138496 00000100:00100000:2.0:1789428039.686937:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940138624 00000100:00100000:2.0:1789428039.686941:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940138624 00000100:00100000:2.0:1789428039.686962:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428039.686974:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940138496:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428039.687023:0:18663:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1789428039.687069:0:18663:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede5196d4 00002000:00100000:2.0:1789428039.687090:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9196adde6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789428039.687095:0:18663:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789428039.687099:0:18663:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428039.687336:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789428039.687371:0:18663:0:(import.c:65:import_set_state_nolock()) ffff9196adde2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428039.687506:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940138496:12345-0@lo:8:kworker.0 Request processed in 532us (15359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.687514:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428039.687535:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428039.687541:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940138624:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789428039.687554:0:18663:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789428039.692256:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc9880 x1876350940138496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428039.692276:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428039.692290:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789428039.692302:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789428039.692311:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789428039.692323:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789428039.692362:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789428039.692371:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940138496:0@lo:8:kworker.0 00000004:00080000:1.0:1789428039.702668:0:17183:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789428039.702796:0:17183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384197380068ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789428039.702805:0:17183:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789428039.703540:0:17184:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789428039.703716:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17184:1876350940139520:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789428039.703823:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428039.704497:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428039.704752:0:18665:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789428039.704761:0:18665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789428039.705083:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789428039.705104:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940139392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428039.705163:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428039.705209:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139392 00000100:00100000:0.0:1789428039.705220:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139392 00000100:00100000:0.0:1789428039.706698:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789428039.706970:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428039.707142:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940139392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789428039.707324:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789428039.707455:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940139392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 744us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428039.707464:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789428039.707541:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196ad92b100 x1876350940139392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428039.707569:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940139392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428039.707735:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139520 00000100:00100000:3.0:1789428039.707745:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139520 00000100:00100000:1.0:1789428039.707949:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428039.707966:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17184:x1876350940139520:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789428039.708110:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789428039.716075:0:18820:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789428039.716093:0:18820:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789428039.716101:0:18820:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1789428039.722080:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940138624:12345-0@lo:8:kworker.0 Request processed in 34528us (49858us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428039.722096:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789428039.722172:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428039.722177:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428039.722184:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940138624:0@lo:8:kworker.0 00002000:00010000:0.0:1789428039.722390:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.722403:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723062:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.723068:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.723075:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723099:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723113:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723122:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723164:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428039.723727:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.723735:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723744:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.723748:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.723753:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723763:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723784:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723791:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.723816:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789428039.724017:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428039.724027:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724036:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.724041:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724050:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724075:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724093:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a1b6fd/0x84fc867ede5196db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724112:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.724115:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724122:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.724125:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724133:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724144:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724151:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede5196e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724163:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.724165:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.724167:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.724397:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.724404:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724458:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.724462:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.724467:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724479:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724487:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724495:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724520:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.724523:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.724529:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724541:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.724545:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724553:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724565:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.724573:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2673a99/0x84fc867ede5196e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.724818:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.724825:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724833:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.724837:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.724841:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724851:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724859:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724866:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.724876:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.725018:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.725023:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725031:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ec00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.725034:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725043:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725055:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725072:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede5196f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725086:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.725088:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.725089:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.725126:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.725132:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725141:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.725149:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.725154:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725163:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725171:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725178:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725197:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.725332:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.725337:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725345:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.725349:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725358:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.725471:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.725477:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725485:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.725489:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.725493:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725504:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725508:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725513:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725515:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186ce99d/0x84fc867ede5196f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725527:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725532:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.725534:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.725536:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.725537:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.725546:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725553:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ee00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.725556:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725563:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.725574:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.725840:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.725847:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725856:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.725859:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.725863:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725873:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725882:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725891:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.725902:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.726054:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000140e8d24/0x84fc867ede5196fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726073:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.726076:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726083:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.726086:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726094:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726119:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726127:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519705 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.726140:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.726142:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.726144:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.726157:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.726162:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726177:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.726180:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.726183:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726192:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726201:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726208:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726227:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428039.726236:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428039.726240:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726246:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428039.726250:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726257:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726278:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726286:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a549ca0d/0x84fc867ede51970c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726300:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.726302:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.726304:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.726584:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.726591:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726600:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.726602:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.726607:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726615:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726624:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726633:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726667:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428039.726676:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428039.726680:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726687:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428039.726691:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.726699:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.727050:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.727085:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727094:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e3586db/0x84fc867ede519713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727110:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.727112:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.727114:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.727574:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.727580:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727590:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.727601:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.727606:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727617:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727627:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727635:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.727693:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428039.728011:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.728017:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728026:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.728029:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.728033:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728044:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728053:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728067:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728093:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428039.728101:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728109:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.728113:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728122:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728141:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728149:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e456ee2/0x84fc867ede51971a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728169:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.728173:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728179:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.728182:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728197:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728209:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728217:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.728219:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.728221:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.728285:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.728291:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1add2a/0x84fc867ede519721 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.728649:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.728666:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728676:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.728680:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.728684:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728694:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728703:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.728722:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728834:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.728840:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728849:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.728853:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728862:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728875:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.728884:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.728887:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.728889:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.728957:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.728963:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e13b06e/0x84fc867ede519728 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.729286:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.729292:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729302:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.729305:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.729309:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729318:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729328:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729335:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.729367:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.729372:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.729379:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.729383:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.729391:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.729404:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.729446:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.729449:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.729452:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.729544:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.729549:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a4f1112/0x84fc867ede51972f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.729922:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.729928:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729938:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.729942:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.729946:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729956:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729965:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.729972:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730006:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.730013:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730020:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.730023:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730032:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730055:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730064:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.730066:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.730067:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.730130:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.730136:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519736 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.730460:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.730466:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.730488:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.730491:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.730495:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.730505:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.730514:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.730523:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730571:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.730576:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730585:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.730588:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730597:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730609:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.730619:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.730621:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.730623:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.730700:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.730705:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede51973d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.731030:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.731036:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731045:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.731048:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.731053:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731074:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731082:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731089:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731120:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.731125:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731144:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.731147:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731155:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731167:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731175:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.731177:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.731179:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.731227:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.731231:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519744 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.731554:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.731560:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731569:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.731572:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.731577:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731586:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731609:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.731616:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731696:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.731702:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731756:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.731760:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731768:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731778:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.731794:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.731795:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.731797:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.731903:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.731909:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede51974b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428039.732210:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.732214:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732221:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.732223:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.732226:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732233:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732238:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732251:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732277:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.732282:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732289:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.732293:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732301:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732313:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732320:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.732321:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.732323:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.732369:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.732374:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519752 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.732748:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.732780:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.732786:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732797:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.732801:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.732805:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732816:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732824:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732832:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.732868:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428039.733085:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.733089:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733095:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209e00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.733103:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733109:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733118:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733123:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e7c94a9/0x84fc867ede519759 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733133:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733134:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733135:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.733190:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.733194:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733200:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.733203:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.733206:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733212:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733217:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733221:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733234:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428039.733267:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.733272:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733280:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.733283:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733292:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733304:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733318:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519760 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733333:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733334:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733336:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.733522:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.733530:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733538:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.733548:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.733552:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733563:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733572:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733579:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733599:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428039.733694:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.733700:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733709:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.733714:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733723:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733738:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733746:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519767 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733763:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733765:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.733770:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.733879:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.733885:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733894:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.733898:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.733902:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733912:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733921:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733937:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.733955:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428039.733978:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428039.733982:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.733993:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208e00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428039.733997:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.734006:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.734017:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.734024:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063823836/0x84fc867ede51976e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428039.734037:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.734038:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.734040:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.734235:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.734241:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.734250:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.734254:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.734258:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.734267:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.734275:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.734282:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.734329:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.734354:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.734361:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.734369:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.734373:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.734382:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.734395:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.734403:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519775 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.734913:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.734915:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.734917:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.734990:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.734996:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735011:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.735015:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.735019:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735029:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735037:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735044:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735065:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.735282:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.735289:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735297:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.735301:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735309:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735321:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735329:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487d21d8/0x84fc867ede51977c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735342:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.735343:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.735345:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.735410:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.735480:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735489:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.735492:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.735496:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735506:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735526:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735533:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.735585:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428039.735824:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.735829:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735849:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.735854:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735862:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735876:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735884:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082bd7b94/0x84fc867ede519783 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.735906:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.735910:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.735914:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428039.735996:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.736003:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736011:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.736014:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.736018:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736027:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736035:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736042:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736099:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428039.736411:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428039.736454:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736464:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789428039.736467:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428039.736471:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736481:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736489:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428039.736496:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736566:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428039.736571:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736580:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.736583:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736592:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736611:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736618:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562b9e3d/0x84fc867ede51978a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736635:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428039.736639:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736647:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428039.736660:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736671:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736682:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428039.736692:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.736694:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428039.736696:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428039.736776:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428039.736782:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004faf21bb/0x84fc867ede519791 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789428039.736835:0:18820:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1789428039.736978:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17184:x1876350940139520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29012us (33149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428039.737007:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428039.737038:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17184:1876350940139520:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789428039.737062:0:17184:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:3.0:1789428039.737076:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428039.737124:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17184:1876350940139648:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789428039.737159:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428039.737188:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789428039.737198:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139648 00000100:00100000:3.0:1789428039.737208:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139648 00000100:00100000:3.0:1789428039.737271:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428039.737282:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1876350940139648:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789428039.737326:0:18665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789428039.746886:0:18659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789428039.746953:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789428039.747326:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17184:x1876350940139648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10039us (10158us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789428039.747352:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428039.747625:0:17184:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789428039.747638:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17184:1876350940139648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789428039.747672:0:17184:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1789428040.433558:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428041.460458:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428041.520600:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940139776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789428041.520700:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940139904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428041.520712:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.521439:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.521511:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139776 00000100:00100000:2.0:1789428041.521522:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139776 00000100:00100000:2.0:1789428041.521571:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940139904 00000100:00100000:2.0:1789428041.521574:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940139904 00000100:00100000:2.0:1789428041.521597:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428041.521609:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940139776:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428041.521644:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428041.521660:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940139904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789428041.521679:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1789428041.521688:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789428041.521757:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940139776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428041.521759:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940139904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.521770:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789428041.521893:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428041.521951:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940139904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428041.521988:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940139776:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789428042.483202:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789428042.909109:0:19028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789428043.504564:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789428043.764810:0:19080:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428043.764981:0:19080:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428044.528956:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789428044.549265:0:19130:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428044.549765:0:19130:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1789428045.104640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428045.104649:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428045.104653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428045.104672:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 384 00000100:00080000:0.0:1789428045.104680:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789428045.104695:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428045.104723:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583fcb800 x1876350940140416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428045.104762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428045.104766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428045.104769:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428045.104773:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789428045.104814:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940140544:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.104896:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.104956:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940141056:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.104975:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105008:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789428045.105014:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940140032:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105042:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105079:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940140672:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105101:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105125:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940140160:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105146:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105160:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940140800:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105177:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105191:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789428045.105196:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940140288:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105214:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105227:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940140928:0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105241:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105261:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940140416:0@lo:8:kworker.0 00000100:00100000:0.0:1789428045.105282:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428045.105312:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140544 00000100:00100000:0.0:1789428045.105321:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140544 00000100:00100000:0.0:1789428045.105362:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141056 00000100:00100000:0.0:1789428045.105364:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141056 00000100:00100000:0.0:1789428045.105387:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140800 00000100:00100000:0.0:1789428045.105389:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140800 00000100:00100000:0.0:1789428045.105399:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140928 00000100:00100000:0.0:1789428045.105401:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140928 00000100:00100000:0.0:1789428045.105442:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428045.105453:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940140544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105507:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940140544:12345-0@lo:400:kworker.0 Request processed in 56us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105515:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428045.105534:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428045.105545:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940141056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105568:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940141056:12345-0@lo:400:kworker.0 Request processed in 24us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105573:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428045.105583:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789428045.105588:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940140800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105623:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940140800:12345-0@lo:400:kworker.0 Request processed in 34us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105629:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789428045.105638:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428045.105644:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940140928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105666:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940140928:12345-0@lo:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105671:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428045.105691:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140032 00000100:00100000:0.0:1789428045.105694:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140032 00000100:00100000:0.0:1789428045.105720:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789428045.105725:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3615:x1876350940140032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105750:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3615:x1876350940140032:12345-0@lo:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105755:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789428045.105781:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140672 00000100:00100000:0.0:1789428045.105784:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140672 00000100:00100000:0.0:1789428045.105804:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140160 00000100:00100000:0.0:1789428045.105806:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140160 00000100:00100000:0.0:1789428045.105817:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789428045.105822:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940140672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105860:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940140672:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105866:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789428045.105876:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428045.105881:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940140160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105899:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940140160:12345-0@lo:400:kworker.0 Request processed in 18us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.105904:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428045.105925:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140288 00000100:00100000:0.0:1789428045.105928:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140288 00000100:00100000:0.0:1789428045.105949:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940140416 00000100:00100000:0.0:1789428045.105952:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940140416 00000100:00100000:0.0:1789428045.105963:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428045.105969:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940140288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428045.105997:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940140288:12345-0@lo:400:kworker.0 Request processed in 28us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428045.106003:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428045.106012:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428045.106017:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3612:x1876350940140416:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789428045.106038:0:18820:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789428045.108287:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940141184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428045.108369:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789428045.109626:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789428045.109637:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789428045.109641:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789428045.109704:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940140032:0@lo:400:kworker.0 00000100:00100000:1.0:1789428045.109761:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940140672:0@lo:400:kworker.0 00010000:00080000:1.0:1789428045.109781:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc8a80 x1876350940140544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428045.109793:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940140544:0@lo:400:kworker.0 00010000:00080000:1.0:1789428045.109806:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc8380 x1876350940141056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428045.109815:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940141056:0@lo:400:kworker.0 00000100:00100000:2.0:1789428045.110245:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141184 00000100:00100000:2.0:1789428045.110257:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141184 00000100:00100000:2.0:1789428045.110320:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428045.110332:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940141184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428045.110375:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428045.110487:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940141184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428045.110516:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428045.110569:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940141184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428045.111258:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940140288:0@lo:400:kworker.0 00010000:00080000:3.0:1789428045.111280:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fcb480 x1876350940140928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428045.111292:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940140928:0@lo:400:kworker.0 00000100:00100000:3.0:1789428045.111306:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940140160:0@lo:400:kworker.0 00010000:00080000:3.0:1789428045.111318:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583fc9c00 x1876350940140800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428045.111326:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940140800:0@lo:400:kworker.0 00000100:00100000:2.0:1789428045.124736:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3612:x1876350940140416:12345-0@lo:8:kworker.0 Request processed in 18707us (19443us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428045.124755:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789428045.124931:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428045.124938:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789428045.124943:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940140416:0@lo:8:kworker.0 00010000:00010000:3.0:1789428045.553067:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428046.580210:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428046.643635:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940141440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428046.643731:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428046.643793:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789428046.643804:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940141312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428046.643829:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428046.643889:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141440 00000100:00100000:0.0:1789428046.643899:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141440 00000100:00100000:0.0:1789428046.643949:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141312 00000100:00100000:0.0:1789428046.643953:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141312 00000100:00100000:0.0:1789428046.643974:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428046.643986:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940141440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428046.644032:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428046.644212:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940141440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 228us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428046.644221:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428046.644243:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428046.644250:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940141312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428046.644272:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789428046.644306:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940141312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428046.644312:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428046.645253:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940141312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428046.645273:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940141440:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789428046.898404:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428047.605514:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789428048.563150:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789428048.624628:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428049.649030:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789428050.224632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428050.224638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428050.224642:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428050.224660:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1789428050.224664:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789428050.224675:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428050.224697:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bdf80 x1876350940142080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428050.225926:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940141568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428050.225996:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.226051:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789428050.226057:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940141696:0@lo:400:kworker.0 00000100:00100000:1.0:1789428050.226083:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.226154:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141696 00000100:00100000:1.0:1789428050.226162:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141696 00000100:00100000:1.0:1789428050.226204:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789428050.226212:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3615:x1876350940141696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428050.226255:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3615:x1876350940141696:12345-0@lo:400:kworker.0 Request processed in 44us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.226262:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789428050.226305:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940141696:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.228223:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940141824:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.228289:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.228353:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428050.228361:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940141952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.228387:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.228566:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141952 00000100:00100000:3.0:1789428050.228573:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141952 00000100:00100000:3.0:1789428050.228628:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428050.228637:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940141952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.228689:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940141952:12345-0@lo:400:kworker.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.228697:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428050.228737:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940141952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.228781:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141568 00000100:00100000:3.0:1789428050.228785:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141568 00000100:00100000:3.0:1789428050.228810:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428050.228817:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940141568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789428050.228837:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428050.228875:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940141568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.228881:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428050.228917:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940141568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428050.229021:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940141824 00000100:00100000:1.0:1789428050.229026:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940141824 00000100:00100000:1.0:1789428050.229063:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789428050.229078:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940141824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428050.229120:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940141824:12345-0@lo:400:kworker.0 Request processed in 43us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.229126:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789428050.229147:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428050.229328:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940141824:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.229398:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428035/real 1789428035] req@ffff9195831be300 x1876350940133376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428050 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.230639:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831be300 x1876350940133376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428050 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.230655:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428035/real 1789428035] req@ffff9195831bed80 x1876350940133504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428050 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.230694:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9195831bed80 x1876350940133504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428050 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.230713:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940142080:0@lo:8:kworker.0 00000100:00100000:0.0:1789428050.230766:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789428050.230803:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428050.230827:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428050.230831:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940133376:0@lo:8:kworker.0 00000100:00080000:0.0:1789428050.230836:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428050.230842:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428050.230844:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940133504:0@lo:8:kworker.0 00000100:00080000:2.0:1789428050.231091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428050.231096:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789428050.231098:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428050.231103:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 379 00000100:00080000:2.0:1789428050.231107:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789428050.231115:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196b5aab000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428050.231134:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bc000 x1876350940142464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428050.231146:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428050.231156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428050.231158:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428050.231162:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 379 00000100:00080000:2.0:1789428050.231164:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789428050.231169:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9196b5b0e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428050.231182:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bf480 x1876350940142592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428050.231276:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142080 00000100:00100000:3.0:1789428050.231283:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142080 00000100:00100000:3.0:1789428050.231317:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428050.231324:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350940142080:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789428050.231344:0:18665:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789428050.231391:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350940142080:12345-0@lo:8:kworker.0 Request processed in 67us (625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789428050.231399:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428050.231446:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940142336:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.231476:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.231499:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789428050.231504:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940142208:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.231528:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.231546:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940142976:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.231584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.231609:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940142720:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.231631:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.231649:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428050.231655:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940142848:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233339:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.233383:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142336 00000100:00100000:3.0:1789428050.233389:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142336 00000100:00100000:3.0:1789428050.233455:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789428050.233464:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940142336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233530:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940142336:12345-0@lo:400:kworker.0 Request processed in 67us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.233537:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789428050.233571:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142208 00000100:00100000:3.0:1789428050.233575:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142208 00000100:00100000:2.0:1789428050.233576:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940142336:0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233593:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142976 00000100:00100000:3.0:1789428050.233596:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142976 00000100:00100000:3.0:1789428050.233633:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142720 00000100:00100000:3.0:1789428050.233637:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142720 00000100:00100000:3.0:1789428050.233648:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142848 00000100:00100000:3.0:1789428050.233651:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142848 00000100:00100000:3.0:1789428050.233666:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428050.233671:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940142208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233708:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940142208:12345-0@lo:400:kworker.0 Request processed in 37us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.233714:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428050.233726:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428050.233732:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940142976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233757:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940142976:12345-0@lo:400:kworker.0 Request processed in 27us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.233762:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428050.233772:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428050.233778:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940142720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233808:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940142720:12345-0@lo:400:kworker.0 Request processed in 30us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.233813:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428050.233825:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789428050.233830:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428050.233858:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940142848:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.233863:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789428050.233897:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9195831bed80 x1876350940142208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428050.233919:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940142208:0@lo:400:kworker.0 00010000:00080000:3.0:1789428050.233932:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919584448e00 x1876350940142976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428050.233941:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940142976:0@lo:400:kworker.0 00000100:00080000:2.0:1789428050.233953:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789428050.233958:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789428050.233965:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9195831bc380 x1876350940142848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428050.233973:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940142848:0@lo:400:kworker.0 00010000:00080000:3.0:1789428050.233984:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9195831bf800 x1876350940142720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428050.234153:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940142464:0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.234196:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.234229:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142464 00000100:00100000:1.0:1789428050.234230:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940142592:0@lo:8:kworker.0 00000100:00100000:2.0:1789428050.234233:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142464 00000100:00100000:2.0:1789428050.234256:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428050.234256:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.234262:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940142464:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1789428050.234281:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:2.0:1789428050.234286:0:18663:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000100:00080000:1.0:1789428050.234286:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789428050.234289:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940142080:0@lo:8:kworker.0 00000020:00000080:2.0:1789428050.234313:0:18663:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519798 00002000:00100000:2.0:1789428050.234326:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9196bbb85000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789428050.234331:0:18663:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789428050.234333:0:18663:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428050.234409:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789428050.234465:0:18663:0:(import.c:65:import_set_state_nolock()) ffff9196bbb87800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428050.234504:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940142464:12345-0@lo:8:kworker.0 Request processed in 241us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428050.234510:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428050.234521:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940142592 00000100:00100000:2.0:1789428050.234524:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940142592 00000100:00100000:2.0:1789428050.234548:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428050.234551:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940142592:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789428050.234574:0:18663:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789428050.234600:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940142592:12345-0@lo:8:kworker.0 Request processed in 47us (344us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428050.234606:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428050.234611:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428050.234618:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789428050.234626:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789428050.234631:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789428050.234633:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789428050.234652:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789428050.234657:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940142464:0@lo:8:kworker.0 00000100:00080000:1.0:1789428050.234667:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428050.234672:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789428050.234674:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940142592:0@lo:8:kworker.0 00000004:00080000:2.0:1789428050.235024:0:17901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789428050.235044:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584449500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143232:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789428050.235075:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.235083:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940143104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789428050.235092:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195827a7540 going to sleep for 11 seconds 00000004:00080000:2.0:1789428050.235106:0:17900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789428050.235108:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789428050.235184:0:17900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 394729768499ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789428050.235191:0:17900:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789428050.235227:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143232 00000100:00100000:2.0:1789428050.235231:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143232 00000100:00100000:2.0:1789428050.235261:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428050.235268:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17901:x1876350940143232:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789428050.235436:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940142720:0@lo:400:kworker.0 00000100:00080000:2.0:1789428050.235457:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428050.235466:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143104 00000100:00100000:3.0:1789428050.235470:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143104 00000100:00100000:3.0:1789428050.235493:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428050.235498:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876350940143104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789428050.235511:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428050.235616:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1876350940143104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.235623:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428050.235989:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940143104:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789428050.237169:0:17891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789428050.238929:0:18663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789428050.238938:0:18663:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789428050.239176:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17901:x1876350940143232:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3904us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.239188:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428050.239281:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584449500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143232:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789428050.239296:0:17901:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789428050.239338:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584449500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143360:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789428050.239374:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.239465:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195827a7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.240200:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143360 00000100:00100000:3.0:1789428050.240209:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143360 00000100:00100000:3.0:1789428050.240292:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789428050.240302:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17901:x1876350940143360:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789428050.240331:0:18664:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789428050.240391:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17901:x1876350940143360:12345-0@lo:5:osp-pre-0-1.0 Request processed in 90us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.240398:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428050.240472:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584449500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143360:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789428050.240483:0:17901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789428050.240512:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143488:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789428050.240540:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.240647:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcbbb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428050.240679:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143488 00000100:00100000:2.0:1789428050.240690:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143488 00000100:00100000:2.0:1789428050.240718:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428050.240726:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17901:x1876350940143488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789428050.240752:0:18665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1789428050.270786:0:18659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789428050.270801:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789428050.271182:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17901:x1876350940143488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30453us (30636us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789428050.271194:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428050.279827:0:17901:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789428050.279844:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1876350940143488:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789428050.279863:0:17901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789428050.280205:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17901:1876350940143616:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789428050.280269:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.280305:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968513fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428050.280373:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143616 00000100:00100000:2.0:1789428050.280380:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143616 00000100:00100000:2.0:1789428050.280465:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428050.280475:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1876350940143616:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789428050.280673:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1876350940143616:12345-0@lo:900:osp-pre-0-1.0 Request processed in 198us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428050.280681:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789428050.280802:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfae1c00 x1876350940143616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.280815:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17901:1876350940143616:0@lo:900:osp-pre-0-1.0 00000020:01000004:3.0:1789428050.623646:0:19475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789428050.623650:0:19475:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789428050.623652:0:19475:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789428050.623798:0:19475:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919583041800 00000020:01000004:3.0:1789428050.623814:0:19475:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789428050.623827:0:19475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789428050.623838:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9196bbde19c0) 00000020:00000080:3.0:1789428050.623854:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789428050.662451:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789428050.665703:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789428050.666367:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789428050.666721:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789428050.666996:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789428050.667191:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789428050.667388:0:19475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1789428050.668260:0:19475:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789428050.668535:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789428050.668550:0:19475:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789428050.668627:0:19475:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede5197a6 00000020:01000004:1.0:1789428050.668639:0:19475:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789428050.668663:0:19475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789428050.668666:0:19475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789428050.668671:0:19475:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789428050.668700:0:19475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789428050.668704:0:19475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1789428050.672642:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789428050.677945:0:19475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789428050.677981:0:19475:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789428050.677986:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789428050.677988:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428050.677990:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428050.677992:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428050.677993:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428050.677994:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428050.677996:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428050.678002:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428050.678003:0:19475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428050.678006:0:19475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789428050.678009:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428050.678010:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428050.678011:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428050.678012:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428050.678013:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428050.678014:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428050.678015:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428050.678017:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428050.678018:0:19475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428050.678043:0:19475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789428050.678061:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940143744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428050.678128:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.678181:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428050.678247:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143744 00000100:00100000:1.0:1789428050.678255:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143744 00000100:00100000:1.0:1789428050.678311:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789428050.678322:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:19475:x1876350940143744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428050.678351:0:17151:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789428050.678354:0:17151:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789428050.678358:0:17151:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789428050.678831:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:19475:x1876350940143744:12345-0@lo:253:mount.lustre.0 Request processed in 510us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.678840:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789428050.678969:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940143744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428050.678979:0:19475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789428050.678981:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428050.678983:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428050.678984:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428050.678985:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428050.678986:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428050.678987:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428050.678988:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428050.678990:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428050.678991:0:19475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789428050.679012:0:19475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919583041800 from lustre-OST0001 10000000:01000000:0.0:1789428050.679041:0:19475:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789428050.679044:0:19475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789428050.679052:0:19475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91958302b380 local copy 00010000:00010000:0.0:1789428050.679061:0:19475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.679139:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940143872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428050.679178:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.679207:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789428050.679350:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940143872 00000100:00100000:1.0:1789428050.679357:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940143872 00000100:00100000:1.0:1789428050.679437:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789428050.679445:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:19475:x1876350940143872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428050.679504:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:19475:x1876350940143872:12345-0@lo:501:mount.lustre.0 Request processed in 60us (325us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789428050.679511:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789428050.679589:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940143872:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789428050.679602:0:19475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789428050.679626:0:19475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789428050.679632:0:19475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.679642:0:19475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428050.679665:0:19475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919583041800 10000000:01000000:0.0:1789428050.679669:0:19475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789428050.679673:0:19475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789428050.679675:0:19475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428050.679680:0:19475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789428050.679682:0:19475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789428050.679702:0:19475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.679710:0:19475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.679719:0:19475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.679730:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428050.679754:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.679917:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789428050.680030:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144000 00000100:00100000:2.0:1789428050.680034:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144000 00000100:00100000:2.0:1789428050.680056:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789428050.680063:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:19475:x1876350940144000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428050.680071:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428050.680081:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375d200/0x84fc867ede5197b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5197ad expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428050.680100:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375d200/0x84fc867ede5197b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5197ad expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428050.680110:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375d200/0x84fc867ede5197b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5197ad expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428050.680129:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375d200, rc 0) 00000100:00100000:2.0:1789428050.680166:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144000:12345-0@lo:101:mount.lustre.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428050.680172:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789428050.680247:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428050.680258:0:19475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.680268:0:19475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428050.681158:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789428050.681982:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428050.687595:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789428050.688081:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789428050.688100:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789428050.688115:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789428050.688127:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789428050.688139:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789428050.688168:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789428050.688174:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789428050.688292:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428050.688361:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.688502:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428050.688936:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144128 00000100:00100000:1.0:1789428050.688944:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144128 00000100:00100000:1.0:1789428050.689033:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789428050.689044:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428050.689223:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144128:12345-0@lo:501:mount.lustre.0 Request processed in 180us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.689244:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789428050.689328:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428050.689368:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428050.689435:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.690024:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144256 00000100:00100000:1.0:1789428050.690031:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144256 00000100:00100000:2.0:1789428050.690128:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789428050.690136:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428050.690309:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968570d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789428050.691456:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144256:12345-0@lo:503:mount.lustre.0 Request processed in 1317us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428050.691467:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789428050.691596:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789428050.692185:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789428050.692294:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428050.692352:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.692397:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.692568:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144384 00000100:00100000:3.0:1789428050.692577:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144384 00000100:00100000:3.0:1789428050.692625:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789428050.692635:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428050.693162:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144384:12345-0@lo:502:mount.lustre.0 Request processed in 527us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.693171:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789428050.693297:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428050.693704:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789428050.693734:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789428050.693748:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789428050.693759:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789428050.693773:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789428050.693785:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789428050.693795:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789428050.693806:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789428050.693816:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789428050.693924:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428050.693977:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.694051:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687f9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.694133:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144512 00000100:00100000:0.0:1789428050.694139:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144512 00000100:00100000:0.0:1789428050.694183:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789428050.694192:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428050.694298:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144512:12345-0@lo:502:mount.lustre.0 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.694305:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789428050.694488:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428050.694533:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789428050.694542:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789428050.695391:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789428050.695399:0:19479:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789428050.695406:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.695443:0:19479:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789428050.695450:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789428050.695465:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9195830299c0) 00000020:00000080:1.0:1789428050.695488:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789428050.695494:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789428050.695584:0:19479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583041800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789428050.695592:0:19479:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789428050.695599:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede5197c2 00010000:00010000:1.0:1789428050.701325:0:19479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789428050.702083:0:19479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789428050.704392:0:19479:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789428050.706377:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789428050.706391:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428050.706398:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.706400:0:19479:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789428050.706404:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428050.706408:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.706409:0:19479:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789428050.708497:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789428050.708505:0:19479:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789428050.708516:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428050.708524:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.708525:0:19479:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789428050.708528:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428050.708532:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.708534:0:19479:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789428050.708538:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789428050.708584:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428050.708588:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428050.708590:0:19479:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789428050.708594:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789428050.708946:0:19475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789428050.708996:0:19475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789428050.709019:0:19475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709032:0:19475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428050.709041:0:19475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583041800 from 1 10000000:01000000:0.0:1789428050.709044:0:19475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428050.709085:0:19475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709094:0:19475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709106:0:19475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.709130:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428050.709207:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.709248:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144640 00000100:00100000:0.0:1789428050.709256:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144640 00000100:00100000:0.0:1789428050.709300:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789428050.709311:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:19475:x1876350940144640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428050.709325:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428050.709337:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5197c9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709358:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709378:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.709386:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209400, rc 0) 00000100:00100000:0.0:1789428050.709444:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940144640:12345-0@lo:101:mount.lustre.0 Request processed in 135us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.709451:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789428050.716733:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.716781:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428050.716809:0:19475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.716823:0:19475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428050.718092:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789428050.718377:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428050.718819:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789428050.718932:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789428050.718960:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789428050.718967:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789428050.719040:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428050.719103:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.719197:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.724095:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144768 00000100:00100000:3.0:1789428050.724118:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144768 00000100:00100000:3.0:1789428050.724185:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789428050.724197:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940144768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428050.724439:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940144768:12345-0@lo:501:mount.lustre.0 Request processed in 221us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.724447:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789428050.724598:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428050.724672:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428050.724726:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.724768:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37180 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.725013:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940144896 00000100:00100000:3.0:1789428050.725018:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940144896 00000100:00100000:3.0:1789428050.725052:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789428050.725061:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940144896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428050.725155:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940144896:12345-0@lo:503:mount.lustre.0 Request processed in 96us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.725162:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789428050.725302:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940144896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789428050.726154:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428050.726254:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428050.726309:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.726354:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37180 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.726574:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145024 00000100:00100000:3.0:1789428050.726582:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145024 00000100:00100000:3.0:1789428050.726632:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789428050.726640:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940145024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428050.726740:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940145024:12345-0@lo:502:mount.lustre.0 Request processed in 101us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.726747:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789428050.727154:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428050.727395:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789428050.727452:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789428050.727469:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789428050.727500:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789428050.727515:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789428050.727527:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789428050.727539:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789428050.727563:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789428050.727578:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789428050.727591:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789428050.727602:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789428050.727629:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428050.727679:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428050.729041:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37180 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.729142:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145152 00000100:00100000:0.0:1789428050.729151:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145152 00000100:00100000:0.0:1789428050.729238:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789428050.729248:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940145152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428050.729410:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940145152:12345-0@lo:502:mount.lustre.0 Request processed in 163us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.729442:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789428050.730276:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428050.730366:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789428050.730389:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789428050.731305:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428050.731323:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.731326:0:19483:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789428050.731333:0:19483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583041800 00000020:00000080:3.0:1789428050.731335:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428050.731343:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428050.731345:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.731347:0:19483:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789428050.731349:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428050.731352:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.731353:0:19483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789428050.731356:0:19483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583041800 00000020:00000080:3.0:1789428050.731358:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428050.731483:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428050.731488:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.731489:0:19483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789428050.731496:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428050.731499:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.731500:0:19483:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428050.731504:0:19483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583041800 00000020:00000080:3.0:1789428050.731506:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428050.732333:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428050.732341:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.732342:0:19483:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428050.732345:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428050.732347:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.732349:0:19483:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789428050.732352:0:19483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583041800 00000020:00000080:3.0:1789428050.732354:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428050.732387:0:19483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428050.732390:0:19483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428050.732391:0:19483:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789428050.732394:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789428050.733591:0:19475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789428050.733704:0:19475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428050.733731:0:19475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.733744:0:19475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428050.733818:0:19475:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789428050.733822:0:19475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919583041800 10000000:01000000:0.0:1789428050.733825:0:19475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919583041800 10000000:01000000:0.0:1789428050.733829:0:19475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428050.733835:0:19475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919583041800 from 1 10000000:01000000:0.0:1789428050.733838:0:19475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789428050.734043:0:19475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.734053:0:19475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.734065:0:19475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.734089:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428050.734151:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.734192:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789428050.734714:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145280 00000100:00100000:3.0:1789428050.734722:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145280 00000100:00100000:3.0:1789428050.734765:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789428050.734775:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:19475:x1876350940145280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428050.734788:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428050.734802:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ecc00/0x84fc867ede5197de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5197d7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428050.734827:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ecc00/0x84fc867ede5197de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5197d7 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428050.734839:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ecc00/0x84fc867ede5197de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5197d7 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428050.734927:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ecc00, rc 0) 00000100:00100000:3.0:1789428050.734988:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145280:12345-0@lo:101:mount.lustre.0 Request processed in 213us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.734995:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789428050.735102:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428050.735118:0:19475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.735129:0:19475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789428050.737161:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789428050.739723:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789428050.741255:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789428050.741300:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789428050.741326:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789428050.741338:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789428050.741350:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789428050.741361:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789428050.741372:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789428050.741384:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789428050.741395:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789428050.741407:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789428050.741468:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789428050.741482:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789428050.741493:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789428050.741504:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789428050.741516:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789428050.741527:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789428050.741538:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789428050.741562:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789428050.741587:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789428050.741600:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789428050.742976:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789428050.743016:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789428050.743043:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789428050.743060:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789428050.743075:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789428050.743089:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789428050.743104:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789428050.743117:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789428050.743130:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789428050.743145:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789428050.743158:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789428050.743171:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789428050.743183:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789428050.743197:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789428050.743229:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789428050.743246:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789428050.743258:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789428050.743270:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789428050.743283:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789428050.743296:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789428050.743311:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789428050.743326:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789428050.743339:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789428050.743353:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789428050.743364:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789428050.743377:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789428050.743402:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789428050.743408:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789428050.743545:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428050.745773:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.745888:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.752724:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145408 00000100:00100000:0.0:1789428050.752738:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145408 00000100:00100000:0.0:1789428050.752799:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789428050.752810:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428050.755258:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145408:12345-0@lo:501:mount.lustre.0 Request processed in 2440us (9481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.755273:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789428050.755331:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428050.755389:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428050.755486:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.755514:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.755534:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145536 00000100:00100000:0.0:1789428050.755540:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145536 00000100:00100000:0.0:1789428050.755588:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789428050.755596:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428050.755815:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145536:12345-0@lo:503:mount.lustre.0 Request processed in 220us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.755823:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789428050.755940:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428050.756333:0:19475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428050.756403:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428050.756486:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.756503:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919684ee3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.756521:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145664 00000100:00100000:0.0:1789428050.756526:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145664 00000100:00100000:0.0:1789428050.756561:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789428050.756576:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428050.759408:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145664:12345-0@lo:502:mount.lustre.0 Request processed in 2822us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.759443:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789428050.765022:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428050.765271:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789428050.765308:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789428050.765324:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789428050.765337:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789428050.765365:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789428050.765380:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789428050.765393:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789428050.765406:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789428050.765441:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789428050.765456:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789428050.765468:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789428050.765480:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789428050.765493:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789428050.765506:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789428050.765517:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789428050.765528:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789428050.765539:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789428050.765565:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789428050.765580:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789428050.765591:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789428050.765630:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789428050.765647:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789428050.765660:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789428050.765674:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789428050.765686:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789428050.765698:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789428050.765710:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789428050.765720:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789428050.765731:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789428050.765742:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789428050.765754:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789428050.765767:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789428050.765778:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789428050.765790:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789428050.765812:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789428050.765826:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789428050.766955:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789428050.766984:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789428050.766997:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789428050.767011:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789428050.767024:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789428050.767038:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789428050.767052:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789428050.767065:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789428050.767079:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789428050.767093:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789428050.767107:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789428050.767118:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789428050.767170:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428050.767250:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.767302:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968843c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789428050.767727:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145792 00000100:00100000:1.0:1789428050.767735:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145792 00000100:00100000:1.0:1789428050.767777:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789428050.767784:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428050.767964:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145792:12345-0@lo:502:mount.lustre.0 Request processed in 179us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.767972:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789428050.768054:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428050.768259:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789428050.768280:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789428050.768300:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428050.768332:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.768357:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583faf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.768705:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940145920 00000100:00100000:0.0:1789428050.768710:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940145920 00000100:00100000:0.0:1789428050.768740:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789428050.768748:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428050.768827:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940145920:12345-0@lo:502:mount.lustre.0 Request processed in 80us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.768834:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789428050.769034:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940145920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428050.769078:0:19475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789428050.769086:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789428050.771136:0:19488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789428050.771162:0:19488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9195845599c0) 00000020:00000080:3.0:1789428050.771190:0:19488:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789428050.771287:0:19488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583041800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428050.771291:0:19488:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583041800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428050.771294:0:19488:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583041800 3 00010000:00080000:3.0:1789428050.771325:0:19488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919583355000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789428050.778010:0:19488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789428050.778275:0:19488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789428050.778318:0:19488:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789428050.778329:0:19488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x84fc867ede5197ec 00000100:00080000:3.0:1789428050.778338:0:19488:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428050.778350:0:19488:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919583355000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428050.778386:0:19488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f5500 x1876350940146048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428050.778448:0:19488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789428050.778747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428050.778752:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428050.778754:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428050.778758:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 394 00000100:00080000:0.0:1789428050.778762:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789428050.778767:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428050.778782:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfae2d80 x1876350940146432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428050.778822:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428050.778825:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428050.778827:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428050.778829:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 394 00000100:00080000:0.0:1789428050.778833:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789428050.778837:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9196b5b0e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428050.778936:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919583cb8a80 x1876350940146944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428050.779082:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940146304:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779146:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779179:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940147072:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779205:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779228:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789428050.779233:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940146176:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779257:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779276:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940146816:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779298:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779325:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940146560:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779349:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779367:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940147200:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779388:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779404:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789428050.779410:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940146688:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779455:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779472:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940147328:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.779492:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.779519:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146304 00000100:00100000:0.0:1789428050.779526:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146304 00000100:00100000:1.0:1789428050.779768:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940146048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428050.779802:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.779824:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940146432:0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.779844:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.779886:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940146944:0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.779908:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.779938:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146816 00000100:00100000:1.0:1789428050.779942:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146816 00000100:00100000:1.0:1789428050.779965:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146432 00000100:00100000:1.0:1789428050.779967:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146432 00000100:00100000:1.0:1789428050.779976:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146944 00000100:00100000:1.0:1789428050.779978:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146944 00000100:00100000:1.0:1789428050.780004:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428050.780014:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940146816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428050.780066:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940146816:12345-0@lo:400:kworker.0 Request processed in 53us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.780072:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428050.780089:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428050.780093:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940146432:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.780140:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940146432:12345-0@lo:8:kworker.0 Request processed in 44us (294us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789428050.780146:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428050.780158:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428050.780162:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940146944:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.780190:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940146944:12345-0@lo:8:kworker.0 Request processed in 26us (281us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789428050.780195:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428050.780222:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428050.780230:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428050.780233:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789428050.780237:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940146432:0@lo:8:kworker.0 00000100:00100000:1.0:1789428050.780256:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428050.780260:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428050.780263:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789428050.780265:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940146944:0@lo:8:kworker.0 00000020:01000004:3.0:1789428050.780549:0:19488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789428050.780573:0:19488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91958455b380) 00000020:00000080:3.0:1789428050.780591:0:19488:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789428050.780674:0:19488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583041800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428050.780678:0:19488:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583041800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428050.780681:0:19488:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583041800 3 00010000:00080000:3.0:1789428050.780706:0:19488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919583353000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.124@tcp at head 00000100:00100000:0.0:1789428050.781980:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428050.782007:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940146304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782079:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940146304:12345-0@lo:400:kworker.0 Request processed in 79us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782092:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428050.782125:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147072 00000100:00100000:0.0:1789428050.782132:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147072 00000100:00100000:0.0:1789428050.782155:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146560 00000100:00100000:0.0:1789428050.782158:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146560 00000100:00100000:0.0:1789428050.782170:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147200 00000100:00100000:0.0:1789428050.782174:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147200 00000100:00100000:0.0:1789428050.782184:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147328 00000100:00100000:0.0:1789428050.782186:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147328 00000100:00100000:0.0:1789428050.782196:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146048 00000100:00100000:0.0:1789428050.782199:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146048 00000100:00100000:0.0:1789428050.782210:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789428050.782216:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940147072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782249:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940147072:12345-0@lo:400:kworker.0 Request processed in 33us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782255:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789428050.782266:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789428050.782272:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940146560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782309:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940146560:12345-0@lo:400:kworker.0 Request processed in 37us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782315:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789428050.782326:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789428050.782332:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940147200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782359:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940147200:12345-0@lo:400:kworker.0 Request processed in 27us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782364:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789428050.782376:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789428050.782389:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940147328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782434:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940147328:12345-0@lo:400:kworker.0 Request processed in 47us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782440:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789428050.782452:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428050.782457:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940146048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789428050.782478:0:17160:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:0.0:1789428050.782510:0:17160:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x84fc867ede5197fa 00000004:00100000:0.0:1789428050.782524:0:17160:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789428050.782569:0:17160:0:(import.c:65:import_set_state_nolock()) ffff919582403800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428050.782626:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3612:x1876350940146048:12345-0@lo:38:llog_process_th.0 Request processed in 167us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782632:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428050.782655:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146176 00000100:00100000:0.0:1789428050.782659:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146176 00000100:00100000:0.0:1789428050.782684:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940146688 00000100:00100000:0.0:1789428050.782687:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940146688 00000100:00100000:0.0:1789428050.782701:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789428050.782706:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940146176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782737:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940146176:12345-0@lo:400:kworker.0 Request processed in 31us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782744:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789428050.782755:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789428050.782760:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.782806:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940146688:12345-0@lo:400:kworker.0 Request processed in 45us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.782822:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789428050.783917:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940146176:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.783940:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940146816:0@lo:400:kworker.0 00000100:00100000:0.0:1789428050.783951:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940146304:0@lo:400:kworker.0 00010000:00080000:0.0:1789428050.783964:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583cb8e00 x1876350940147072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.783973:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940147072:0@lo:400:kworker.0 00010000:00010000:3.0:1789428050.784460:0:19488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1789428050.784604:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940146688:0@lo:400:kworker.0 00010000:00080000:0.0:1789428050.784694:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583cb9880 x1876350940147328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.784705:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940147328:0@lo:400:kworker.0 00010000:00080000:0.0:1789428050.784717:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfae1180 x1876350940146560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.784724:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940146560:0@lo:400:kworker.0 00010000:00080000:0.0:1789428050.784733:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919583cbad80 x1876350940147200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.784741:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940147200:0@lo:400:kworker.0 00010000:00080000:0.0:1789428050.786142:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bf9f5500 x1876350940146048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428050.786156:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428050.786166:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789428050.786181:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789428050.786187:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789428050.786191:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789428050.786198:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940146048:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789428050.789830:0:19488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789428050.789959:0:19488:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789428050.789973:0:19488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x84fc867ede519801 00000100:00080000:3.0:1789428050.789984:0:19488:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428050.789998:0:19488:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff919583353000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428050.790034:0:19488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f6d80 x1876350940147456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428050.790062:0:19488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789428050.791049:0:19488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789428050.791100:0:19475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789428050.791129:0:19475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789428050.791144:0:19475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428050.791155:0:19475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789428050.791204:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789428050.791221:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428050.791223:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428050.791224:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428050.791225:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428050.791226:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428050.791227:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428050.791229:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428050.791230:0:19475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428050.791234:0:19475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789428050.791237:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428050.791238:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428050.791239:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428050.791240:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428050.791241:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428050.791242:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428050.791243:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428050.791243:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428050.791244:0:19475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428050.791263:0:19475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789428050.791277:0:19475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940147584:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428050.791349:0:19475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.791383:0:19475:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583faf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428050.791564:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147584 00000100:00100000:1.0:1789428050.791571:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147584 00000100:00100000:1.0:1789428050.791622:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789428050.791630:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940147584:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428050.791654:0:17153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789428050.791667:0:17153:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789428050.792095:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940147456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789428050.792140:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428050.793565:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147456 00000100:00100000:3.0:1789428050.793576:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147456 00000100:00100000:3.0:1789428050.795963:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789428050.795978:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940147456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789428050.796014:0:17160:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:3.0:1789428050.796053:0:17160:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x84fc867ede519808 00000004:00100000:3.0:1789428050.796070:0:17160:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789428050.796106:0:17160:0:(import.c:65:import_set_state_nolock()) ffff919583353800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428050.796204:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3612:x1876350940147456:12345-0@lo:38:llog_process_th.0 Request processed in 227us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.796212:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789428050.796281:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bf9f6d80 x1876350940147456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428050.796293:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428050.796302:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789428050.796310:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789428050.796315:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789428050.796317:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583353000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428050.796324:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940147456:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789428050.802824:0:17153:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789428050.802842:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789428050.802921:0:17175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789428050.802926:0:17175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789428050.802947:0:17175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.802967:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 24 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.802975:0:17175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.802982:0:17175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803018:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803031:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 24 pid: 17153 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.803046:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940147712:0@lo:104: 00000100:00100000:0.0:1789428050.803106:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428050.803154:0:17175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 24 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803171:0:17175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 24 pid: 17152 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428050.803180:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940147840:0@lo:104: 00000100:00100000:0.0:1789428050.803201:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428050.803220:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff919683fdb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428050.803241:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147712 00000100:00100000:0.0:1789428050.803248:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147712 00000100:00100000:0.0:1789428050.803282:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147840 00000100:00100000:0.0:1789428050.803284:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147840 00000100:00100000:0.0:1789428050.803296:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428050.803303:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940147712:12345-0@lo:104: 00010000:00010000:0.0:1789428050.803314:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803355:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789428050.803360:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:17175:x1876350940147712:12345-0@lo:104: Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.803367:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428050.803381:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428050.803386:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940147840:12345-0@lo:104: 00010000:00010000:0.0:1789428050.803392:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803516:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789428050.803522:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:17175:x1876350940147840:12345-0@lo:104: Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428050.803535:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789428050.803562:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428050.803568:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803575:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428050.803579:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.803587:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428050.803594:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428050.803599:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789428050.803933:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:19475:x1876350940147584:12345-0@lo:253:mount.lustre.0 Request processed in 12303us (12582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428050.803942:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789428050.803990:0:19475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c098993-d5b4-48be-b0c2-bdb904c28b81:19475:1876350940147584:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789428050.804001:0:19475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789428050.804003:0:19475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789428050.804005:0:19475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428050.804007:0:19475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428050.804008:0:19475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428050.804010:0:19475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428050.804011:0:19475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428050.804012:0:19475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428050.804014:0:19475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428050.804015:0:19475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789428050.804027:0:19475:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789428050.804822:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.804832:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789428050.804937:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940147968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428050.804975:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428050.805018:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.805025:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f47000/0x84fc867ede5196c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196cd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.805039:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428050.805043:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.805061:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428050.805064:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.805071:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428050.805078:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428050.805083:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428050.805099:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.805105:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789428050.812745:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428050.812765:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940148096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428050.812840:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428050.817730:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940147968 00000100:00100000:1.0:1789428050.817744:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940147968 00010000:00010000:1.0:1789428050.817780:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 24 pid: 17153 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428050.817810:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148096 00000100:00100000:1.0:1789428050.817814:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148096 00010000:00010000:1.0:1789428050.817827:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 25 pid: 17152 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428050.817842:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428050.817864:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+25:3613:x1876350940147968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428050.817891:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428050.817898:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 25 pid: 17153 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.817909:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 25 pid: 17153 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.817928:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428050.817997:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+25:3613:x1876350940147968:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (13020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.818004:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428050.818023:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428050.818030:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940148096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428050.818038:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428050.818042:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 24 pid: 17152 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818050:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 24 pid: 17152 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818062:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818070:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789428050.818085:0:17145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015159445s 00010000:00010000:1.0:1789428050.818090:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818108:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818115:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818123:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818129:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428050.818133:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818141:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818150:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818160:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428050.818186:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940148096:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (5346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428050.818192:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789428050.818223:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428050.818253:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940148096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428050.818264:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940147968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428050.818301:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375cc00/0x84fc867ede5196cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5196c6 expref: 23 pid: 17153 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428050.818323:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940147712:0@lo:104: 00010000:00010000:1.0:1789428050.818337:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e000/0x84fc867ede5196bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5196b8 expref: 22 pid: 17152 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428050.818344:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17175:1876350940147840:0@lo:104: 00010000:00010000:1.0:1789428050.818359:0:17175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818369:0:17175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818375:0:17175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428050.818382:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209c00/0x84fc867ede51980f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.819221:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.819235:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f47a00/0x84fc867ede5196b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5196bf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428050.819302:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428050.819304:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428050.819306:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789428050.829977:0:19475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789428050.832780:0:19475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789428050.832790:0:19475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789428050.832831:0:19475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789428050.832969:0:19475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789428050.832991:0:19475:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789428050.833018:0:19475:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789428050.836782:0:19475:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428050.837032:0:19475:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789428051.696779:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789428051.725777:0:19542:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428051.725949:0:19542:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789428051.762448:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940148224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428051.762536:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428051.762616:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148224 00000100:00100000:0.0:1789428051.762625:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148224 00000100:00100000:0.0:1789428051.762835:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789428051.762847:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940148224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428051.762887:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428051.763183:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940148352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789428051.763218:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428051.763249:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148352 00000100:00100000:3.0:1789428051.763253:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148352 00000100:00100000:3.0:1789428051.763284:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789428051.763289:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940148352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428051.763307:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428051.763351:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940148352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428051.763358:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789428051.763402:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940148352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428051.764834:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940148224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1984us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428051.764847:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789428051.765335:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940148224:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1789428052.401478:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789428052.401485:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919698b0d800 from 10 10000000:01000000:1.0:1789428052.401491:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789428052.401552:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428052.401579:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428052.401591:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428052.401616:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428052.401681:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428052.401739:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428052.401747:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148480 00000100:00100000:0.0:1789428052.401757:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148480 00000100:00100000:0.0:1789428052.401818:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789428052.401829:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940148480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428052.401842:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428052.401855:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208800/0x84fc867ede51981d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519816 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428052.401879:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208800/0x84fc867ede51981d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519816 expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428052.401891:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208800/0x84fc867ede51981d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519816 expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428052.401912:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208800, rc 0) 00000100:00100000:0.0:1789428052.401958:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940148480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428052.401965:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789428052.401984:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428052.402001:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428052.402011:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428052.402058:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789428052.402086:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428052.402106:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428052.402127:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148608 00000100:00100000:3.0:1789428052.402133:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148608 00000100:00100000:1.0:1789428052.402247:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789428052.402259:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940148608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428052.402274:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428052.402293:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428052.402297:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789428052.402388:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940148608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428052.402405:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789428052.402506:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789428052.402586:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428052.402606:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428052.402616:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428052.402626:0:17156:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789428052.402629:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bfad4800 from 10 10000000:01000000:3.0:1789428052.402632:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428052.402653:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428052.402661:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428052.402669:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428052.402694:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428052.402725:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428052.402768:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b5b5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789428052.402842:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148736 00000100:00100000:2.0:1789428052.402848:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148736 00000100:00100000:2.0:1789428052.402880:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789428052.402889:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940148736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428052.402898:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428052.402907:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375ce00/0x84fc867ede51982b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519824 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428052.402927:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375ce00/0x84fc867ede51982b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519824 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428052.402937:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375ce00/0x84fc867ede51982b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519824 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428052.402944:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375ce00, rc 0) 00000100:00100000:2.0:1789428052.402978:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940148736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428052.402985:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789428052.402989:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428052.403004:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428052.403013:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428052.403058:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789428052.403093:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428052.403119:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b5b5a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789428052.403205:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148864 00000100:00100000:0.0:1789428052.403210:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148864 00000100:00100000:0.0:1789428052.403242:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789428052.403250:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940148864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789428052.403263:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789428052.403277:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789428052.403281:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789428052.403363:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940148864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428052.403370:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789428052.403454:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940148864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789428052.403612:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789428052.403619:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428052.403627:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428052.724953:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428053.745563:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428054.770932:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428055.344714:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789428055.344737:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940148992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428055.344815:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.345547:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940148992 00000100:00100000:2.0:1789428055.345558:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940148992 00000100:00100000:2.0:1789428055.345613:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428055.345623:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940148992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789428055.345652:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428055.345708:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940148992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.345715:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789428055.345736:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428055.345771:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940148992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789428055.346440:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428055.346452:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428055.346491:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.346564:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149120 00000100:00100000:2.0:1789428055.346570:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149120 00000100:00100000:2.0:1789428055.346614:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428055.346620:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940149120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428055.346633:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428055.346665:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940149120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.346672:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428055.346779:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940149120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789428055.346795:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789428055.790677:0:19832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789428055.796894:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428055.856845:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428055.856851:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789428055.856856:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428055.856874:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196867e4800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428055.856896:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f5880 x1876350940149632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428055.856930:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428055.856933:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789428055.856935:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428055.856941:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9196b5b0e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428055.856963:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bf9f7800 x1876350940150144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428055.857015:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940149376:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857083:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857124:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940150016:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857148:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857167:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940150656:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857194:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857219:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789428055.857225:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940149248:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857252:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857273:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940149888:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857295:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857310:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940150528:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857327:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857347:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940149504:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857366:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857381:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940150272:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857399:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857446:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940150784:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857469:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857482:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789428055.857487:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940149760:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857519:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857538:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940150400:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857557:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857713:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940149632:0@lo:8:kworker.0 00000100:00100000:3.0:1789428055.857737:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857755:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940150144:0@lo:8:kworker.0 00000100:00100000:3.0:1789428055.857774:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.857804:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149376 00000100:00100000:3.0:1789428055.857811:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149376 00000100:00100000:3.0:1789428055.857852:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149888 00000100:00100000:3.0:1789428055.857856:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149888 00000100:00100000:3.0:1789428055.857872:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428055.857879:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940149376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857929:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940149376:12345-0@lo:400:kworker.0 Request processed in 50us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.857937:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428055.857953:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789428055.857960:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940149888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.857987:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940149888:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.857993:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789428055.858011:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150016 00000100:00100000:3.0:1789428055.858015:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150016 00000100:00100000:3.0:1789428055.858033:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149504 00000100:00100000:3.0:1789428055.858036:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149504 00000100:00100000:3.0:1789428055.858046:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149632 00000100:00100000:3.0:1789428055.858049:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149632 00000100:00100000:3.0:1789428055.858057:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150144 00000100:00100000:3.0:1789428055.858059:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150144 00000100:00100000:3.0:1789428055.858080:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428055.858087:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940150016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.858118:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940150016:12345-0@lo:400:kworker.0 Request processed in 32us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.858124:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428055.858137:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428055.858143:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.858174:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940149504:12345-0@lo:400:kworker.0 Request processed in 32us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.858181:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428055.858191:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428055.858195:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3612:x1876350940149632:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789428055.858222:0:18664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:3.0:1789428055.858250:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519832 00002000:00100000:3.0:1789428055.858264:0:18664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff919583351800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789428055.858269:0:18664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789428055.858272:0:18664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789428055.858718:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149248 00000100:00100000:2.0:1789428055.858735:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149248 00000100:00100000:2.0:1789428055.858767:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789428055.858774:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428055.858810:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940149248:12345-0@lo:400:kworker.0 Request processed in 37us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.858816:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00002000:00080000:3.0:1789428055.859004:0:18664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789428055.859028:0:18664:0:(import.c:65:import_set_state_nolock()) ffff919583357800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428055.859074:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940149632:12345-0@lo:8:kworker.0 Request processed in 877us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.859080:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428055.859093:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428055.859097:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3612:x1876350940150144:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789428055.859113:0:18664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:3.0:1789428055.859139:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519839 00002000:00100000:3.0:1789428055.859146:0:18664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff919583352800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789428055.859150:0:18664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789428055.859152:0:18664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789428055.859183:0:18664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789428055.859197:0:18664:0:(import.c:65:import_set_state_nolock()) ffff919583356800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428055.859228:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940150144:12345-0@lo:8:kworker.0 Request processed in 129us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.859235:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428055.859259:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150656 00000100:00100000:3.0:1789428055.859264:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150656 00010000:00080000:2.0:1789428055.859356:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5880 x1876350940149632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789428055.859371:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789428055.859379:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789428055.859384:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789428055.859386:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789428055.859401:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789428055.859406:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940149632:0@lo:8:kworker.0 00010000:00080000:2.0:1789428055.859456:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f7800 x1876350940150144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789428055.859466:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789428055.859471:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789428055.859474:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789428055.859476:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789428055.859487:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789428055.859491:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940150144:0@lo:8:kworker.0 00000004:00080000:2.0:1789428055.859573:0:17903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789428055.859593:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584449f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151040:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789428055.859622:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.859646:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863f000 going to sleep for 11 seconds 00000004:00080000:2.0:1789428055.859660:0:17902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789428055.859721:0:17902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 400354305093ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789428055.859727:0:17902:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789428055.859876:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940150912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428055.859904:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.859932:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150912 00000100:00100000:2.0:1789428055.859936:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150912 00000100:00100000:3.0:1789428055.860004:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150528 00000100:00100000:3.0:1789428055.860009:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150528 00000004:00080000:0.0:1789428055.861533:0:17185:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789428055.861607:0:17185:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400356191268ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789428055.861614:0:17185:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789428055.861665:0:17186:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789428055.861685:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17186:1876350940151296:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789428055.861730:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428055.861746:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37540 going to sleep for 11 seconds 00000100:00080000:1.0:1789428055.863679:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789428055.863690:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789428055.863692:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428055.864290:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428055.864303:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1876350940150912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789428055.864334:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789428055.864431:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1876350940150912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.864524:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428055.864556:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428055.864593:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.864634:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151168 00000100:00100000:2.0:1789428055.864643:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151168 00000100:00100000:2.0:1789428055.864668:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428055.864674:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940151168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789428055.864687:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789428055.864717:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940151168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.864724:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789428055.864756:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583cb9880 x1876350940151168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428055.864776:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940151168:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789428055.864820:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919584448000 x1876350940150912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428055.864835:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940150912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428055.864958:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151040 00000100:00100000:2.0:1789428055.864963:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151040 00000100:00100000:2.0:1789428055.864982:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151296 00000100:00100000:2.0:1789428055.864985:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151296 00000100:00100000:2.0:1789428055.864998:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428055.865004:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1876350940151040:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1789428055.865273:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428055.866196:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150272 00000100:00100000:3.0:1789428055.866206:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150272 00000100:00100000:3.0:1789428055.866223:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150784 00000100:00100000:3.0:1789428055.866226:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150784 00000100:00100000:3.0:1789428055.866241:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940149760 00000100:00100000:3.0:1789428055.866244:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940149760 00000100:00100000:3.0:1789428055.866255:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940150400 00000100:00100000:3.0:1789428055.866257:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940150400 00000100:00100000:3.0:1789428055.866274:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789428055.866282:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866350:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940150656:12345-0@lo:400:kworker.0 Request processed in 69us (9154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866356:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789428055.866373:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428055.866379:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866407:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940150528:12345-0@lo:400:kworker.0 Request processed in 28us (9079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866455:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428055.866471:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789428055.866477:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866520:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940150272:12345-0@lo:400:kworker.0 Request processed in 44us (9120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866526:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789428055.866538:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789428055.866544:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866570:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940150784:12345-0@lo:400:kworker.0 Request processed in 27us (9100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866575:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789428055.866585:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428055.866590:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940149760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866611:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940149760:12345-0@lo:400:kworker.0 Request processed in 21us (9093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866616:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428055.866624:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428055.866629:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940150400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.866648:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940150400:12345-0@lo:400:kworker.0 Request processed in 20us (9091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.866653:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428055.866684:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428055.866690:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17186:x1876350940151296:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789428055.867702:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789428055.867730:0:17891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:0.0:1789428055.868296:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789428055.868302:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:2.0:1789428055.871559:0:18664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789428055.871581:0:18664:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789428055.871745:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1876350940151040:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6735us (12117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.871757:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789428055.872943:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6a00 x1876350940149760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.872966:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940149760:0@lo:400:kworker.0 00010000:00080000:3.0:1789428055.872982:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4000 x1876350940150400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.872990:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940150400:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.873001:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940149504:0@lo:400:kworker.0 00010000:00080000:3.0:1789428055.873010:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5c00 x1876350940150272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.873016:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940150272:0@lo:400:kworker.0 00010000:00080000:3.0:1789428055.873025:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f4380 x1876350940150784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.873032:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940150784:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.873075:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940149248:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.873085:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940149888:0@lo:400:kworker.0 00010000:00080000:3.0:1789428055.873095:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f7b80 x1876350940150528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.873102:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940150528:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.873111:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940149376:0@lo:400:kworker.0 00000100:00100000:3.0:1789428055.873120:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940150016:0@lo:400:kworker.0 00010000:00080000:3.0:1789428055.873128:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6680 x1876350940150656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.873142:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940150656:0@lo:400:kworker.0 00010000:00080000:1.0:1789428055.874681:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919584449f80 x1876350940151040/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789428071 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428055.874697:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584449f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151040:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789428055.874713:0:17903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789428055.874759:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151424:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789428055.874816:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428055.874852:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789428055.874954:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151424 00000100:00100000:2.0:1789428055.874963:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151424 00000100:00100000:2.0:1789428055.875017:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428055.875027:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1876350940151424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789428055.875054:0:18665:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789428055.875140:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1876350940151424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.875148:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789428055.879169:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfaab800 x1876350940151424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789428071 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428055.879188:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151424:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789428055.879203:0:17903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789428055.879250:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151552:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789428055.879306:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.879735:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19180 going to sleep for 11 seconds 00000100:00100000:1.0:1789428055.881453:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151552 00000100:00100000:1.0:1789428055.881465:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151552 00000100:00100000:1.0:1789428055.881530:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789428055.881542:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1876350940151552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789428055.881590:0:18664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1789428055.881864:0:18820:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789428055.881872:0:18820:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789428055.881877:0:18820:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:1.0:1789428055.900715:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428055.900727:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900751:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789428055.900756:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428055.900762:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900780:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900792:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900800:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900820:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428055.900833:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428055.900839:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900846:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f47a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428055.900851:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900859:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900888:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900896:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0423fc/0x84fc867ede519840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.900914:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428055.900916:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428055.900918:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.903797:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.903810:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.903839:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.903843:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.903851:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.903869:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.903880:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.903889:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.903910:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428055.904356:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.904362:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.904371:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.904375:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.904379:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.904389:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.904408:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.904613:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.904629:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789428055.904987:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.904993:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.905002:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.905005:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.905009:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.905018:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.905025:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.905032:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.905052:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789428055.909512:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789428055.909526:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909541:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.909545:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909557:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909693:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909702:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909725:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428055.909729:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909736:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375cc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.909739:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909761:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909773:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909781:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51984e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909794:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428055.909798:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909805:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.909808:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909816:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909825:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909832:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.909857:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.909858:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.909860:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.909867:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.915293:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.915306:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.915325:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.915331:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.915337:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.915353:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.915364:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.915379:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.915404:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428055.916837:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428055.916847:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.916858:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.916862:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.916873:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.916892:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.916900:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede51985c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.916920:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.916923:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.916924:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.923357:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.923369:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.923396:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.923402:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.923409:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.924895:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.924909:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.924917:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.925062:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428055.925659:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.925667:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.925681:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.925686:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.925691:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.925702:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.925722:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.925730:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927744:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428055.927757:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927770:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.927775:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927786:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927807:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927815:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede519863 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927838:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.927841:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927860:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375cc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.927863:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927872:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927882:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.927890:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.927891:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.927893:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.929581:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789428055.929595:0:18820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51986a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930145:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.930272:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.930279:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930292:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.930296:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.930303:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930316:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930327:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930348:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930371:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428055.930526:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.930533:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930541:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.930545:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930555:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930582:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930597:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede519871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.930615:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.930618:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.930620:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.930933:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.930939:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930948:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.930952:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.930956:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930965:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930973:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.930981:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931002:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428055.931259:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.931265:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931279:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.931282:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.931286:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931295:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931303:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931309:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.931324:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789428055.931653:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428055.931659:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931667:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.931671:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931678:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931692:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931699:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede519878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931715:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.931719:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931732:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375da00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.931735:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931743:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931754:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931761:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51987f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.931774:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.931776:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.931777:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.931784:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.932665:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.932675:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.932685:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.932689:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.932694:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.932705:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.932726:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.932734:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.932752:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428055.933692:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.933702:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.933712:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.933717:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.933739:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.933758:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.933766:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede519886 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.933785:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.933787:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.933789:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.933896:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.933902:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.933912:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.933916:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.933921:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.933931:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.933940:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.933948:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.933981:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428055.934533:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.934539:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.934547:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.934551:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.934559:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.934571:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.934591:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103c7efd/0x84fc867ede51988d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.934605:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.934607:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.934609:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428055.935630:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428055.935638:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.935651:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789428055.935655:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428055.935661:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.935671:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.935680:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.935687:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.935699:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428055.935784:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428055.935791:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.935799:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428055.935803:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.935811:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.935824:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.935832:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede519894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.935848:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.935850:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428055.935852:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.940059:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.940074:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940092:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.940098:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.940105:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940121:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940132:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940141:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940163:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428055.940976:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.940984:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.940996:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.940999:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.941004:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941028:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941037:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941044:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941071:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789428055.941340:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428055.941348:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941358:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.941368:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941377:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941396:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941404:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51989b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789428055.941643:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.941649:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941658:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.941662:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.941666:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941675:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941683:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941703:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.941711:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789428055.941954:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428055.941959:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941967:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eda00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.941971:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941979:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941990:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.941997:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a5525a/0x84fc867ede5198a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942019:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428055.942022:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942029:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.942033:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942041:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942052:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942058:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c9259/0x84fc867ede5198a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.942070:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.942072:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.942073:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789428055.942204:0:19476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789428055.942228:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789428055.942232:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789428055.942665:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428055.942805:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1876350940151552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61263us (63496us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789428055.942814:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428055.943550:0:17903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00002000:00010000:3.0:1789428055.943690:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.943698:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.943712:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.943715:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.943720:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.943734:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.943744:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.943751:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.943767:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789428055.944101:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1876350940151552:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789428055.944127:0:17903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789428055.944180:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876350940151680:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789428055.944226:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428055.944254:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb68a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428055.944281:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151680 00000100:00100000:2.0:1789428055.944287:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151680 00000100:00100000:2.0:1789428055.944326:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428055.944334:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876350940151680:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789428055.944379:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876350940151680:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428055.944386:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:3.0:1789428055.944656:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.944663:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.944681:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.944685:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.944690:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.944700:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.944709:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.944716:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.944729:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789428055.945024:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428055.945031:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945040:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428055.945044:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945053:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945071:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945091:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac876f1f/0x84fc867ede5198b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945110:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428055.945113:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945120:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428055.945123:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945131:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945142:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945149:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede5198b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428055.945161:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428055.945162:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428055.945164:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1789428055.945651:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919584448000 x1876350940151680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428071 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428055.945667:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876350940151680:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789428055.945698:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.945808:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.945814:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.945823:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.945827:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.945831:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.945842:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.945863:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.945871:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.945891:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428055.946537:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428055.946544:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.946552:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ee00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428055.946556:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.946624:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.946650:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.946658:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000140e8d24/0x84fc867ede5198be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428055.946673:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.946675:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.946677:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.946925:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.946932:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.946942:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.946946:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.946951:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.946961:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.946971:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.946978:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.947013:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428055.948676:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.948688:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.948702:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.948706:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.948712:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.948723:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.948732:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.948740:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.948763:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789428055.949097:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428055.949104:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949113:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.949122:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949131:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949149:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949157:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186ce99d/0x84fc867ede5198c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949175:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.949178:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949184:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ec00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.949187:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949194:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949204:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949210:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede5198cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949229:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.949231:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.949232:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428055.949322:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.949629:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.949635:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.949645:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.949653:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.949658:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.949668:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.949677:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.949684:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.949700:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428055.949899:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.949904:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949912:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.949916:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949923:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949936:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949943:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2673a99/0x84fc867ede5198d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.949956:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.949958:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.949960:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.950638:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.950645:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.950654:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.950658:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.950661:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.950670:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.950678:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.950691:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.950715:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428055.950856:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.950862:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.950881:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.950885:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.950893:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.950906:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.950913:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a549ca0d/0x84fc867ede5198da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.950929:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.950931:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.950932:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.951004:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.951010:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951017:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.951020:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.951024:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951033:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951041:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951048:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951068:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428055.951295:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.951300:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.951307:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.951310:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.951318:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.951336:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.951343:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc593d5b/0x84fc867ede5198e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.951359:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.951361:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.951363:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.951708:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.951714:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951728:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.951731:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.951735:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951744:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951753:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951759:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.951779:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428055.953716:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.953729:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.953744:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.953748:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.953753:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.953767:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.953789:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.953797:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.953813:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789428055.954042:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428055.954049:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954059:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.954063:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954073:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954089:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954098:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a1b6fd/0x84fc867ede5198e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954127:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.954131:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954138:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375cc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.954141:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954149:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954159:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954167:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede5198ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954180:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.954182:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.954184:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.954190:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.954271:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.954277:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954286:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.954289:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.954293:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954303:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954311:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954319:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954351:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428055.954566:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.954571:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954578:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.954587:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954596:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954607:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954614:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede5198f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.954627:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.954629:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.954630:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428055.954706:0:18820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428055.954712:0:18820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954720:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789428055.954724:0:18820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428055.954728:0:18820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954736:0:18820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954745:0:18820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954753:0:18820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428055.954775:0:18820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789428055.954806:0:18820:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1789428055.954902:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17186:x1876350940151296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88207us (93166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428055.954911:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428055.954963:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17186:1876350940151296:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789428055.954985:0:17186:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789428055.955029:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17186:1876350940151808:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789428055.955063:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428055.955086:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583fafc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428055.955104:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151808 00000100:00100000:3.0:1789428055.955109:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151808 00000100:00100000:3.0:1789428055.955144:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789428055.955152:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17186:x1876350940151808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789428055.955182:0:18663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1789428055.955285:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428055.955290:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.955299:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375da00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428055.955302:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.955309:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.955320:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.955335:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede5198fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428055.955350:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.955351:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428055.955353:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428055.973292:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876350940151808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18133us (18222us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789428055.973305:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789428055.977850:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17186:1876350940151808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789428055.977869:0:17186:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:3.0:1789428056.116270:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789428056.512354:0:19884:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428056.512802:0:19884:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428056.818050:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428056.883875:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428056.883898:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940151936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428056.883967:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428056.884013:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940151936 00000100:00100000:0.0:1789428056.884019:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940151936 00000100:00100000:0.0:1789428056.884061:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789428056.884070:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940151936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428056.884102:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789428056.884145:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940151936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428056.884152:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789428056.884198:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940151936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428056.884608:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789428056.884617:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428056.884644:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428056.884686:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152064 00000100:00100000:0.0:1789428056.884691:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152064 00000100:00100000:0.0:1789428056.884717:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789428056.884724:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428056.884743:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428056.884777:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428056.884783:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789428056.884809:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152064:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789428057.290748:0:19934:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428057.290981:0:19934:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789428057.551689:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.552977:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686016 00000100:00100000:3.0:1789428057.552990:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686016 00000100:00100000:3.0:1789428057.553046:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:3.0:1789428057.553055:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1876350931686016:12345-192.168.202.24@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789428057.553088:0:17153:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d@192.168.202.24@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1789428057.553126:0:17153:0:(genops.c:1384:class_connect()) connect: client 4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d, cookie 0x84fc867ede519904 00000100:00080000:3.0:1789428057.553274:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9196bca00000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428057.553521:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+5:2393:x1876350931686016:12345-192.168.202.24@tcp:250:mount.lustre.0 Request processed in 465us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.553530:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:2.0:1789428057.568757:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428057.568912:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686144 00000100:00100000:0.0:1789428057.568923:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686144 00000100:00100000:0.0:1789428057.568979:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:0.0:1789428057.568990:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+5:14868:x1876350931686144:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428057.569008:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428057.569026:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208400/0x84fc867ede51990b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300efd expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.569052:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208400/0x84fc867ede51990b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300efd expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.569063:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208400/0x84fc867ede51990b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300efd expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.569073:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208400, rc 0) 00000100:00100000:0.0:1789428057.569135:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+6:14868:x1876350931686144:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 147us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.569158:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:2.0:1789428057.579551:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.579668:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686272 00000100:00100000:3.0:1789428057.579678:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686272 00000100:00100000:3.0:1789428057.579725:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:3.0:1789428057.579733:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+6:14868:x1876350931686272:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789428057.579858:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+6:14868:x1876350931686272:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 126us (318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428057.579877:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:1.0:1789428057.589819:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428057.590106:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686400 00000100:00100000:2.0:1789428057.590117:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686400 00000100:00100000:2.0:1789428057.590183:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:2.0:1789428057.590195:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+6:14868:x1876350931686400:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789428057.590218:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428057.590242:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428c00/0x84fc867ede519912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300f04 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428057.590276:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428c00/0x84fc867ede519912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f04 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428057.590307:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428c00/0x84fc867ede519912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f04 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428057.590318:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428c00, rc 0) 00000100:00100000:2.0:1789428057.590382:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+7:14868:x1876350931686400:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 189us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428057.590389:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:2.0:1789428057.593539:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428057.593703:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686528 00000100:00100000:0.0:1789428057.593713:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686528 00000100:00100000:0.0:1789428057.593841:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1789428057.593853:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+7:14868:x1876350931686528:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789428057.594029:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14868:x1876350931686528:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 178us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.594038:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1789428057.600961:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428057.601049:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686656 00000100:00100000:1.0:1789428057.601060:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686656 00000100:00100000:1.0:1789428057.601250:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:1.0:1789428057.601262:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14868:x1876350931686656:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789428057.601408:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14868:x1876350931686656:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 149us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.601461:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:1.0:1789428057.604521:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.604860:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686784 00000100:00100000:3.0:1789428057.604869:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686784 00000100:00100000:3.0:1789428057.604980:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:3.0:1789428057.604992:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931686784:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428057.605156:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931686784:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 166us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.605163:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:2.0:1789428057.658859:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428057.659687:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931686912 00000100:00100000:1.0:1789428057.659705:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931686912 00000100:00100000:1.0:1789428057.659824:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:1.0:1789428057.659835:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931686912:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428057.660069:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931686912:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 235us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.660078:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:2.0:1789428057.668759:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.669198:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687040 00000100:00100000:3.0:1789428057.669212:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687040 00000100:00100000:3.0:1789428057.669306:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:3.0:1789428057.669320:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931687040:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428057.669699:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14886:x1876350931687040:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 381us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.669709:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:2.0:1789428057.672967:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428057.673207:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687168 00000100:00100000:1.0:1789428057.673222:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687168 00000100:00100000:1.0:1789428057.673341:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:1.0:1789428057.673351:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:14868:x1876350931687168:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428057.673372:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428057.673401:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46800/0x84fc867ede519919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300f35 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.673680:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46800/0x84fc867ede519919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f35 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.673717:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46800/0x84fc867ede519919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f35 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.673728:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46800, rc 0) 00000100:00100000:1.0:1789428057.673833:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+9:14868:x1876350931687168:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 483us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.673840:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:2.0:1789428057.677737:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.677803:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687296 00000100:00100000:3.0:1789428057.677818:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687296 00000100:00100000:0.0:1789428057.678227:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1789428057.678246:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+9:14868:x1876350931687296:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789428057.678280:0:17152:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789428057.678316:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789428057.678320:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789428057.678323:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789428057.678327:0:17152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789428057.678329:0:17152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789428057.680331:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+9:14868:x1876350931687296:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 2077us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.680349:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:2.0:1789428057.683533:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428057.683787:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687424 00000100:00100000:1.0:1789428057.683810:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687424 00000100:00100000:1.0:1789428057.683885:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:1.0:1789428057.683898:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+9:14868:x1876350931687424:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428057.683928:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428057.683952:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300f3c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.683991:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.684004:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428057.684015:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46400, rc 0) 00000100:00100000:1.0:1789428057.684091:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14868:x1876350931687424:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 195us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.684099:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:2.0:1789428057.687362:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428057.687796:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687552 00000100:00100000:0.0:1789428057.687820:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687552 00000100:00100000:0.0:1789428057.687912:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:0.0:1789428057.687925:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14868:x1876350931687552:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789428057.688132:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14868:x1876350931687552:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 209us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.688160:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:2.0:1789428057.694241:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.694359:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687680 00000100:00100000:3.0:1789428057.694376:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687680 00000100:00100000:3.0:1789428057.694551:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:3.0:1789428057.694564:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14868:x1876350931687680:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789428057.695088:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14868:x1876350931687680:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 527us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.695096:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1789428057.698834:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428057.699050:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687808 00000100:00100000:1.0:1789428057.699077:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687808 00000100:00100000:1.0:1789428057.699180:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:1.0:1789428057.699192:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14893:x1876350931687808:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428057.699636:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14893:x1876350931687808:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 444us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.699644:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:2.0:1789428057.703636:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.703769:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931687936 00000100:00100000:3.0:1789428057.703806:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931687936 00000100:00100000:3.0:1789428057.703888:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:3.0:1789428057.703903:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14893:x1876350931687936:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428057.704270:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:14893:x1876350931687936:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 369us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.704281:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:2.0:1789428057.717716:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.717799:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688064 00000100:00100000:3.0:1789428057.717814:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688064 00000100:00100000:2.0:1789428057.717830:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.717877:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688320 00000100:00100000:3.0:1789428057.717881:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688320 00000100:00100000:3.0:1789428057.717898:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1789428057.718173:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931688064:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789428057.718214:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e6ed65ac-7f4d-4931-a4b8-22e3b619fb76@192.168.202.24@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1789428057.718311:0:17159:0:(genops.c:1384:class_connect()) connect: client e6ed65ac-7f4d-4931-a4b8-22e3b619fb76, cookie 0x84fc867ede519927 00000004:00100000:3.0:1789428057.718346:0:17159:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789428057.718897:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9196bca05000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428057.719001:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2393:x1876350931688064:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 831us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.726791:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789428057.727924:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428057.730857:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688576 00000100:00100000:0.0:1789428057.730879:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688576 00000100:00100000:0.0:1789428057.731046:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789428057.731061:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931688320:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428057.731105:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e6ed65ac-7f4d-4931-a4b8-22e3b619fb76@192.168.202.24@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1789428057.731171:0:17159:0:(genops.c:1384:class_connect()) connect: client e6ed65ac-7f4d-4931-a4b8-22e3b619fb76, cookie 0x84fc867ede51992e 00000004:00100000:0.0:1789428057.731204:0:17159:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789428057.732063:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00080000:3.0:1789428057.732243:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789428057.732270:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688192 00000100:00100000:1.0:1789428057.732280:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688192 00000100:00080000:1.0:1789428057.732677:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428057.732811:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2393:x1876350931688320:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 1748us (14975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.732822:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1789428057.732853:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789428057.732862:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:14868:x1876350931688576:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428057.732898:0:17159:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789428057.733023:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:14868:x1876350931688576:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 162us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.733031:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789428057.733047:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1789428057.733054:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:0:x1876350931688192:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428057.733067:0:17159:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789428057.733089:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:0:x1876350931688192:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 36us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428057.733095:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1789428057.735167:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428057.735210:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.735674:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688448 00000100:00100000:3.0:1789428057.735688:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688448 00000100:00100000:2.0:1789428057.735880:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688704 00000100:00100000:2.0:1789428057.735885:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688704 00000100:00100000:2.0:1789428057.735905:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789428057.735915:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:0:x1876350931688448:12345-192.168.202.24@tcp:41:mount.lustre.0 00000100:00080000:3.0:1789428057.736084:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1789428057.736121:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789428057.736615:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:0:x1876350931688448:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 470us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428057.736627:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789428057.736651:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789428057.736659:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931688704:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789428057.736699:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931688704:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 41us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428057.736705:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789428057.739793:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428057.739897:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428057.739938:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.740082:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688832 00000100:00100000:3.0:1789428057.740095:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688832 00000100:00100000:3.0:1789428057.740148:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931688960 00000100:00100000:3.0:1789428057.740152:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931688960 00000100:00100000:3.0:1789428057.740178:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428057.740209:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1876350931688832:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789428057.740269:0:18665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e6ed65ac-7f4d-4931-a4b8-22e3b619fb76@192.168.202.24@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1789428057.740317:0:18665:0:(genops.c:1384:class_connect()) connect: client e6ed65ac-7f4d-4931-a4b8-22e3b619fb76, cookie 0x84fc867ede519935 00002000:00100000:3.0:1789428057.740333:0:18665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6ed65ac-7f4d-4931-a4b8-22e3b619fb76/ffff9196bca04000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789428057.740357:0:18665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789428057.740853:0:18665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789428057.740895:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196bca01800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428057.741055:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2393:x1876350931688832:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 847us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.741064:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428057.741087:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789428057.741093:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1876350931688960:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789428057.741114:0:18665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e6ed65ac-7f4d-4931-a4b8-22e3b619fb76@192.168.202.24@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1789428057.741136:0:18665:0:(genops.c:1384:class_connect()) connect: client e6ed65ac-7f4d-4931-a4b8-22e3b619fb76, cookie 0x84fc867ede51993c 00002000:00100000:3.0:1789428057.741152:0:18665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6ed65ac-7f4d-4931-a4b8-22e3b619fb76/ffff9196bca03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789428057.741167:0:18665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789428057.742707:0:18665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789428057.742756:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196bca07000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428057.742831:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2393:x1876350931688960:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 1733us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.742842:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1789428057.744158:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689088 00000100:00100000:0.0:1789428057.744173:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689088 00000100:00100000:0.0:1789428057.744257:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:0.0:1789428057.744267:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931689088:12345-192.168.202.24@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789428057.744369:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931689088:12345-192.168.202.24@tcp:900:mount.lustre.0 Request processed in 103us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.744377:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:2.0:1789428057.748996:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428057.749120:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689216 00000100:00100000:3.0:1789428057.749133:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689216 00000100:00100000:3.0:1789428057.749207:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1789428057.749246:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931689216:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789428057.751657:0:17162:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2295us 00000004:00200000:3.0:1789428057.764999:0:17162:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789428057.765192:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14868:x1876350931689216:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 15945us (16210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428057.765205:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00010000:00010000:0.0:1789428057.840753:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428057.953159:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428057.953462:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689344 00000100:00100000:0.0:1789428057.953476:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689344 00000100:00100000:0.0:1789428057.953870:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1789428057.953883:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14916:x1876350931689344:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:0.0:1789428057.953912:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428057.953947:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede519943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300f6d expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954055:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954101:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954120:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428057.954191:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428057.954196:0:17159:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428057.954259:0:17159:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954293:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209600/0x84fc867ede519943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f6d expref: 8 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954327:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f6d expref: 7 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428057.954338:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:0.0:1789428057.954341:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428057.954346:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208000, rc 0) 00000100:00100000:0.0:1789428057.954493:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:14916:x1876350931689344:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 604us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428057.954502:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000040:00080000:3.0:1789428058.801227:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789428058.865685:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428059.890826:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428059.895632:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428059.895904:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689472 00000100:00100000:2.0:1789428059.895920:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689472 00000100:00100000:2.0:1789428059.896019:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1789428059.896031:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:14968:x1876350931689472:12345-192.168.202.24@tcp:41:lfs.0 00000004:00000024:2.0:1789428059.896084:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789428059.896345:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:14968:x1876350931689472:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 245us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428059.896354:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00080000:3.0:1789428059.897000:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428059.899586:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428059.899903:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689600 00000100:00100000:0.0:1789428059.899918:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689600 00000100:00100000:0.0:1789428059.900018:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1789428059.900032:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689600:12345-192.168.202.24@tcp:41:lfs.0 00000004:00000024:0.0:1789428059.900171:0:17159:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428059.900306:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689600:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 276us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428059.900315:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:3.0:1789428059.901052:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428059.907506:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428059.907791:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689728 00000100:00100000:2.0:1789428059.907806:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689728 00000100:00100000:2.0:1789428059.908192:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789428059.908207:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689728:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:2.0:1789428059.908291:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428059.908576:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689728:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 373us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428059.908586:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00080000:3.0:1789428059.908726:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428059.913842:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428059.913964:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689856 00000100:00100000:2.0:1789428059.913980:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689856 00000100:00100000:2.0:1789428059.914078:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1789428059.914101:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689856:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:2.0:1789428059.914149:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789428059.914533:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:14968:x1876350931689856:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 434us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428059.914542:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00080000:3.0:1789428059.914614:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789428060.097306:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.097615:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931689984 00000100:00100000:2.0:1789428060.097645:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931689984 00000100:00100000:2.0:1789428060.097728:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:2.0:1789428060.097744:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:15003:x1876350931689984:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789428060.097768:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428060.097794:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428a00/0x84fc867ede519951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300f74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.097839:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428a00/0x84fc867ede519951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f74 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.097853:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428a00/0x84fc867ede519951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f74 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.097864:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428a00, rc 0) 00000100:00100000:2.0:1789428060.097971:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931689984:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 231us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.097978:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:1.0:1789428060.102949:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.103058:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690112 00000100:00100000:3.0:1789428060.103073:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690112 00000100:00100000:3.0:1789428060.103153:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:3.0:1789428060.103168:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931690112:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789428060.104563:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931690112:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 1389us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.104576:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:1.0:1789428060.107455:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428060.109665:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690240 00000100:00100000:0.0:1789428060.109684:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690240 00000100:00100000:0.0:1789428060.109772:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:0.0:1789428060.109785:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931690240:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789428060.109986:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931690240:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 204us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.110002:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:1.0:1789428060.114462:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.115192:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690368 00000100:00100000:3.0:1789428060.115206:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690368 00000100:00100000:3.0:1789428060.115330:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:3.0:1789428060.115344:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690368:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428060.115647:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690368:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 305us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.115656:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:1.0:1789428060.143645:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428060.144144:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690496 00000100:00100000:0.0:1789428060.144159:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690496 00000100:00100000:0.0:1789428060.144240:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:0.0:1789428060.144254:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690496:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428060.144519:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690496:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 267us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.144529:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:0.0:1789428060.156052:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.156186:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690624 00000100:00100000:3.0:1789428060.156218:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690624 00000100:00100000:3.0:1789428060.156292:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:3.0:1789428060.156305:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690624:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428060.156639:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15008:x1876350931690624:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 335us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.156648:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:3.0:1789428060.162178:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428060.166749:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690752 00000100:00100000:1.0:1789428060.166774:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690752 00000100:00100000:1.0:1789428060.166881:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:1.0:1789428060.166895:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:15003:x1876350931690752:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428060.166920:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428060.166959:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47000/0x84fc867ede519958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300fa5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428060.167002:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47000/0x84fc867ede519958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fa5 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428060.167018:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47000/0x84fc867ede519958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fa5 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428060.167030:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47000, rc 0) 00000100:00100000:1.0:1789428060.167120:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:15003:x1876350931690752:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 227us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.167130:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:1.0:1789428060.172146:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.172291:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931690880 00000100:00100000:3.0:1789428060.172307:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931690880 00000100:00100000:3.0:1789428060.172484:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:3.0:1789428060.172502:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:15003:x1876350931690880:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789428060.172550:0:17153:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789428060.172589:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789428060.172595:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789428060.172599:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789428060.172602:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789428060.172605:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789428060.179699:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:15003:x1876350931690880:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 7182us (7550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.179720:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:1.0:1789428060.184085:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.185025:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691008 00000100:00100000:2.0:1789428060.185041:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691008 00000100:00100000:2.0:1789428060.185127:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:2.0:1789428060.185140:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:15003:x1876350931691008:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789428060.185167:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428060.185195:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300fac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.185238:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.185253:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428060.185264:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429c00, rc 0) 00000100:00100000:2.0:1789428060.185434:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15003:x1876350931691008:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 279us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.185442:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:1.0:1789428060.192043:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.192144:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691136 00000100:00100000:3.0:1789428060.192158:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691136 00000100:00100000:3.0:1789428060.192234:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:3.0:1789428060.192248:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15003:x1876350931691136:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789428060.192724:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15003:x1876350931691136:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 477us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.192758:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789428060.198165:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428060.201783:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691264 00000100:00100000:0.0:1789428060.201807:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691264 00000100:00100000:0.0:1789428060.201899:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:0.0:1789428060.201914:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15003:x1876350931691264:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789428060.202143:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15003:x1876350931691264:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 232us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.202161:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:1.0:1789428060.208845:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.208935:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691392 00000100:00100000:3.0:1789428060.208949:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691392 00000100:00100000:3.0:1789428060.209033:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:3.0:1789428060.209046:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15014:x1876350931691392:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428060.209296:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15014:x1876350931691392:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 251us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.209305:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:3.0:1789428060.219766:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428060.222614:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691520 00000100:00100000:1.0:1789428060.222639:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691520 00000100:00100000:1.0:1789428060.222737:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:1.0:1789428060.222762:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15014:x1876350931691520:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428060.223057:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:15014:x1876350931691520:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 298us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.223066:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:2.0:1789428060.229539:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.229656:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.235698:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.235766:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.235837:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692288 00000100:00100000:3.0:1789428060.235852:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692288 00000100:00100000:3.0:1789428060.235935:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:3.0:1789428060.235949:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2395:x1876350931692288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428060.236050:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2395:x1876350931692288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 104us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.236059:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:2.0:1789428060.237756:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.237784:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692800 00000100:00100000:2.0:1789428060.237794:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692800 00000100:00100000:2.0:1789428060.237891:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789428060.237907:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692800:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428060.238008:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692800:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.238016:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789428060.238072:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428060.240120:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691648 00000100:00100000:0.0:1789428060.240147:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691648 00000100:00100000:0.0:1789428060.240404:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691904 00000100:00100000:0.0:1789428060.240409:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691904 00000100:00100000:0.0:1789428060.240437:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692544 00000100:00100000:0.0:1789428060.240441:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692544 00000100:00100000:0.0:1789428060.240504:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789428060.240515:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428060.240613:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 99us (4847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.240629:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789428060.240652:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1789428060.240656:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931691648:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428060.240687:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3@192.168.202.24@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:0.0:1789428060.240849:0:17159:0:(genops.c:1384:class_connect()) connect: client 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3, cookie 0x84fc867ede519966 00000004:00100000:0.0:1789428060.240883:0:17159:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789428060.241447:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9196b5b32800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428060.241511:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2393:x1876350931691648:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 852us (11986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.241520:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1789428060.241542:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1789428060.241548:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931691904:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428060.241568:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3@192.168.202.24@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:0.0:1789428060.241617:0:17159:0:(genops.c:1384:class_connect()) connect: client 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3, cookie 0x84fc867ede51996d 00000004:00100000:0.0:1789428060.241634:0:17159:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789428060.241686:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9196b5b36000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428060.241715:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2393:x1876350931691904:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 165us (12059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.241723:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789428060.242597:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.242677:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692416 00000100:00100000:3.0:1789428060.242689:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692416 00000100:00100000:3.0:1789428060.242743:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:3.0:1789428060.242753:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2395:x1876350931692416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428060.243008:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692672 00000100:00100000:0.0:1789428060.243014:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692672 00000100:00100000:3.0:1789428060.243057:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2395:x1876350931692416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 305us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.243069:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:0.0:1789428060.243069:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1789428060.243226:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692672:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428060.243261:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2395:x1876350931692672:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 108us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.243269:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1789428060.249646:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.249709:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.249746:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.249919:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692032 00000100:00100000:2.0:1789428060.249933:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692032 00000100:00100000:1.0:1789428060.249973:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692160 00000100:00100000:1.0:1789428060.249980:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692160 00000100:00100000:2.0:1789428060.250014:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931691776 00000100:00100000:2.0:1789428060.250019:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931691776 00000100:00100000:1.0:1789428060.250032:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789428060.250052:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:0:x1876350931692032:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428060.250095:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1789428060.250191:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789428060.250195:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789428060.250345:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:0:x1876350931692032:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 301us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.250655:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789428060.250667:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789428060.256165:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428060.256185:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+7:15003:x1876350931692160:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428060.256298:0:19948:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428060.256397:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+7:15003:x1876350931692160:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 220us (6688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.256404:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428060.256493:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428060.256502:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:0:x1876350931691776:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428060.256514:0:19948:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428060.257057:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:0:x1876350931691776:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 555us (7308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.257064:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789428060.259642:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1789428060.265255:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428060.265436:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931692928 00000100:00100000:2.0:1789428060.265450:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931692928 00000100:00100000:2.0:1789428060.265528:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1789428060.265540:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931692928:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789428060.271257:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931692928:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 5699us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.271279:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789428060.273123:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.273603:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.278479:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428060.278605:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693312 00000100:00100000:1.0:1789428060.278618:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693312 00000100:00100000:1.0:1789428060.278699:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789428060.278713:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931693312:12345-192.168.202.24@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789428060.279320:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931693312:12345-192.168.202.24@tcp:900:mount.lustre.0 Request processed in 607us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.279330:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1789428060.279486:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693056 00000100:00100000:2.0:1789428060.279494:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693056 00000100:00100000:2.0:1789428060.279526:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693184 00000100:00100000:2.0:1789428060.279531:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693184 00000100:00100000:0.0:1789428060.279551:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789428060.279563:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789428060.279564:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1876350931693056:12345-192.168.202.24@tcp:8:mount.lustre.0 00000100:00100000:2.0:1789428060.279576:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1876350931693184:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789428060.279601:0:18665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3@192.168.202.24@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:0.0:1789428060.279638:0:18665:0:(genops.c:1384:class_connect()) connect: client 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3, cookie 0x84fc867ede519974 00002000:00100000:0.0:1789428060.279650:0:18665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3/ffff9196b5b30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789428060.279661:0:18665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1789428060.279668:0:18820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3@192.168.202.24@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:2.0:1789428060.279700:0:18820:0:(genops.c:1384:class_connect()) connect: client 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3, cookie 0x84fc867ede51997b 00002000:00080000:0.0:1789428060.279757:0:18665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00100000:2.0:1789428060.279771:0:18820:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3/ffff9196bbb87000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:0.0:1789428060.279798:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196b5b35800 : changing import state from RECOVER to FULL 00002000:00100000:2.0:1789428060.279801:0:18820:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789428060.279839:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2393:x1876350931693056:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 279us (6725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.279854:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00002000:00080000:2.0:1789428060.279867:0:18820:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789428060.280144:0:18820:0:(import.c:65:import_set_state_nolock()) ffff9196bbb83000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428060.280241:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2393:x1876350931693184:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 665us (6636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.280388:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789428060.282271:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428060.282374:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693440 00000100:00100000:3.0:1789428060.282384:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693440 00000100:00100000:3.0:1789428060.282572:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1789428060.282585:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931693440:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789428060.282692:0:17163:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789428060.282782:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15003:x1876350931693440:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 202us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.282805:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1789428060.451541:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428060.452740:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693568 00000100:00100000:0.0:1789428060.452756:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693568 00000100:00100000:0.0:1789428060.453213:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789428060.453228:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15037:x1876350931693568:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:0.0:1789428060.453255:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428060.453281:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300fdd expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453366:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453383:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453400:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428060.453515:0:19948:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428060.453520:0:19948:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428060.453544:0:19948:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453577:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 8 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453671:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 7 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428060.453709:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:0.0:1789428060.453713:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428060.453718:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209e00, rc 0) 00000100:00100000:0.0:1789428060.453932:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+7:15037:x1876350931693568:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 707us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.453940:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:1.0:1789428060.465578:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428060.465637:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940152192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428060.465729:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428060.465982:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152192 00000100:00100000:1.0:1789428060.465994:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152192 00000100:00100000:1.0:1789428060.466073:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428060.466086:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940152192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428060.466114:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428060.466168:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940152192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.466176:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428060.466233:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940152192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789428060.466260:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428060.466316:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940152320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789428060.466354:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428060.466393:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152320 00000100:00100000:2.0:1789428060.466398:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152320 00000100:00080000:0.0:1789428060.472736:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428060.474897:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789428060.474921:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940152320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789428060.474960:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428060.475096:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940152320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (8740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428060.475221:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940152320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428060.487228:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789428060.912736:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428060.976900:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977001:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977080:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940153216:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977105:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977121:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940153728:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977147:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977174:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789428060.977181:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152576:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977212:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977242:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940153088:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977264:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977284:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940153600:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977305:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977339:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152576 00000100:00100000:3.0:1789428060.977349:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152576 00000100:00100000:3.0:1789428060.977401:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153088 00000100:00100000:3.0:1789428060.977452:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153088 00000100:00100000:3.0:1789428060.977487:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789428060.977498:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977569:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152576:12345-0@lo:400:kworker.0 Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.977576:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789428060.977602:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789428060.977608:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940153088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977637:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940153088:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428060.977643:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789428060.977669:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940152832:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977694:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977712:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940153344:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977732:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977746:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940153856:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977787:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977808:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789428060.977815:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940152448:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977843:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977866:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940152960:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977887:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977903:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940153472:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977924:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.977934:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940153984:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.977962:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428060.978005:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152576:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.978018:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940153088:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978343:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152704 00000100:00100000:0.0:1789428060.978349:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152704 00000100:00100000:0.0:1789428060.978380:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153216 00000100:00100000:0.0:1789428060.978383:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153216 00000100:00100000:0.0:1789428060.978398:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152832 00000100:00100000:0.0:1789428060.978401:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152832 00000100:00100000:0.0:1789428060.978471:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153344 00000100:00100000:0.0:1789428060.978475:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153344 00000100:00100000:0.0:1789428060.978493:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428060.978501:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978558:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940152704:12345-0@lo:400:kworker.0 Request processed in 57us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.978565:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428060.978578:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428060.978583:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978608:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940153216:12345-0@lo:400:kworker.0 Request processed in 24us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.978614:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428060.978641:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428060.978647:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940152832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978679:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940152832:12345-0@lo:400:kworker.0 Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.978685:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428060.978694:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428060.978699:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978735:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940153344:12345-0@lo:400:kworker.0 Request processed in 36us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.978741:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789428060.978758:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428060.978782:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940152832:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978798:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940153344:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978826:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153728 00000100:00100000:0.0:1789428060.978829:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153728 00000100:00080000:0.0:1789428060.978846:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428060.978863:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153600 00000100:00100000:0.0:1789428060.978866:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153600 00000100:00080000:0.0:1789428060.978876:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428060.978885:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153856 00000100:00100000:0.0:1789428060.978888:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153856 00000100:00080000:0.0:1789428060.978897:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428060.978906:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152960 00000100:00100000:0.0:1789428060.978909:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152960 00000100:00100000:0.0:1789428060.978917:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153472 00000100:00100000:0.0:1789428060.978920:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153472 00000100:00100000:0.0:1789428060.978930:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940153984 00000100:00100000:0.0:1789428060.978933:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940153984 00000100:00080000:0.0:1789428060.978942:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428060.978962:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789428060.978968:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940153728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.978999:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940153728:12345-0@lo:400:kworker.0 Request processed in 31us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979005:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789428060.979015:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789428060.979020:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940153600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979041:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940153600:12345-0@lo:400:kworker.0 Request processed in 21us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979046:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789428060.979055:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789428060.979061:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940153856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979087:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940153856:12345-0@lo:400:kworker.0 Request processed in 27us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979093:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789428060.979111:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940153856:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979126:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789428060.979131:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979157:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940152960:12345-0@lo:400:kworker.0 Request processed in 27us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979163:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789428060.979181:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940152960:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979195:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428060.979200:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979237:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940153472:12345-0@lo:400:kworker.0 Request processed in 37us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979243:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428060.979268:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940153472:0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979284:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789428060.979290:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940153984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428060.979321:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940153984:12345-0@lo:400:kworker.0 Request processed in 32us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428060.979327:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789428060.979352:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fc3b80 x1876350940153984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428060.979364:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940153984:0@lo:400:kworker.0 00000100:00100000:1.0:1789428060.979827:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940154112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428060.979876:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428060.979931:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154112 00000100:00100000:1.0:1789428060.979937:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154112 00000100:00100000:3.0:1789428060.979996:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940153600:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.980008:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789428060.980018:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940153216:0@lo:400:kworker.0 00010000:00080000:3.0:1789428060.980030:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fc1880 x1876350940153728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428060.980041:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940153728:0@lo:400:kworker.0 00000100:00100000:1.0:1789428060.982867:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428060.982904:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940154112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428060.982945:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789428060.983064:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940154112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (3187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.983072:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428060.983154:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940154112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428060.983198:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940152448 00000100:00100000:1.0:1789428060.983205:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940152448 00000100:00100000:1.0:1789428060.983244:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789428060.983251:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3615:x1876350940152448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428060.983316:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3615:x1876350940152448:12345-0@lo:400:kworker.0 Request processed in 66us (5472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.983323:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789428060.983474:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428060.983488:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940154240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789428060.983880:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428060.983923:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154240 00000100:00100000:1.0:1789428060.983929:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154240 00000100:00100000:1.0:1789428060.983953:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428060.983961:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940154240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789428060.983974:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789428060.984008:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940154240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428060.984015:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428060.984045:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940154240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789428060.984305:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940152448:0@lo:400:kworker.0 00000001:00100000:1.0:1789428061.493809:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:1.0:1789428061.493829:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000001:00080000:1.0:1789428061.493840:0:19476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1789428061.939302:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428062.005756:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940154368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428062.005868:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428062.005942:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789428062.005950:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940154496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428062.005978:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428062.006064:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154368 00000100:00100000:0.0:1789428062.006078:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154368 00000100:00100000:0.0:1789428062.006149:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154496 00000100:00100000:0.0:1789428062.006152:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154496 00000100:00100000:0.0:1789428062.006173:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789428062.006185:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940154368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428062.006250:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428062.006333:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940154368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428062.006342:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789428062.006366:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428062.006396:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940154496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428062.006462:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789428062.006499:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940154496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428062.006506:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428062.006566:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940154496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428062.006584:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940154368:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789428062.963043:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789428063.055105:0:20033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789428063.538478:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:1.0:1789428063.538502:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000001:00100000:0.0:1789428063.540123:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:0.0:1789428063.540144:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000001:00100000:0.0:1789428063.540814:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:0.0:1789428063.540827:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00010000:00010000:0.0:1789428063.984652:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428065.011058:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428065.588550:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940154624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428065.588633:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428065.588726:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154624 00000100:00100000:3.0:1789428065.588734:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154624 00000100:00100000:3.0:1789428065.588797:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428065.588807:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940154624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789428065.588841:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428065.588886:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940154624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428065.588892:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428065.588948:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940154624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789428065.591989:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428065.592589:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940154752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428065.592748:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428065.592890:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940154752 00000100:00100000:1.0:1789428065.592899:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940154752 00000100:00100000:1.0:1789428065.592954:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428065.592964:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940154752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789428065.592988:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428065.593036:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940154752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428065.593043:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428065.593187:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940154752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789428065.593209:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428065.764207:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428065.764246:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428065.764278:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428065.764279:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693696 00000100:00100000:2.0:1789428065.764299:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428065.764306:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693696 00000100:00100000:2.0:1789428065.764318:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428065.764341:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428065.764360:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428065.764385:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428065.764448:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:2.0:1789428065.764456:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428065.764469:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2396:x1876350931693696:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.764494:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693952 00000100:00100000:2.0:1789428065.764506:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693952 00000100:00100000:2.0:1789428065.764564:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694464 00000100:00100000:2.0:1789428065.764567:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694464 00000100:00100000:2.0:1789428065.764580:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931693824 00000100:00100000:2.0:1789428065.764583:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931693824 00000100:00100000:3.0:1789428065.764600:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2396:x1876350931693696:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 133us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.764603:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694336 00000100:00100000:2.0:1789428065.764609:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694336 00000100:00100000:3.0:1789428065.764616:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:2.0:1789428065.764645:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789428065.764657:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931693952:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.764731:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931693952:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 78us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.764738:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789428065.764759:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789428065.764768:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.764789:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.764795:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789428065.764813:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789428065.764820:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2396:x1876350931693824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.764848:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2396:x1876350931693824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.764858:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789428065.764872:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1789428065.764885:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2396:x1876350931694336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428065.764944:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694208 00000100:00100000:3.0:1789428065.764951:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694208 00000100:00100000:3.0:1789428065.765000:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694720 00000100:00100000:3.0:1789428065.765004:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694720 00000100:00100000:3.0:1789428065.765020:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694080 00000100:00100000:3.0:1789428065.765022:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694080 00000100:00100000:3.0:1789428065.765034:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694592 00000100:00100000:3.0:1789428065.765036:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694592 00000100:00100000:3.0:1789428065.765052:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1789428065.765060:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931694208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.768294:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2396:x1876350931694336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 3402us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.768311:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:3.0:1789428065.768366:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931694208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 3237us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.768368:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1789428065.768388:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789428065.768397:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.768518:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 134us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428065.768546:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1789428065.768569:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931694080:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428065.768775:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931694080:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 78us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.769099:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1789428065.769111:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1789428065.769133:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:2.0:1789428065.769151:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428065.769196:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2396:x1876350931694592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 53us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428065.769206:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:3.0:1789428065.769210:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789428065.769219:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789428065.769226:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789428065.769230:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789428066.040846:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789428066.066718:0:20180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff68d818e0 20000000:00000080:3.0:1789428066.066738:0:20180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196bbb94800 uarg=0000000000000000 20000000:01000000:3.0:1789428066.066794:0:20180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789428066.066801:0:20180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789428066.066806:0:20180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789428066.067724:0:20181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789428066.067986:0:20180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789428066.076260:0:20180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789428066.076360:0:20180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076388:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51961e expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076397:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51962c expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076405:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51966b expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076604:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076617:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076625:0:20180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076633:0:20180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076698:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.076730:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 12 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.076748:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940154880:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428066.078531:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.078552:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 12 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.078567:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155008:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428066.078644:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.078654:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.078665:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155136:0@lo:104: 00000100:00100000:3.0:1789428066.078720:0:20180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428066.078761:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.078770:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.078780:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155264:0@lo:104: 00000100:00100000:3.0:1789428066.078802:0:20180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428066.078847:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.078856:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 23 pid: 17153 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.078865:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155392:0@lo:104: 00000100:00100000:3.0:1789428066.078887:0:20180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428066.079255:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155136 00000100:00100000:2.0:1789428066.079281:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155264 00000100:00100000:2.0:1789428066.079289:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155264 00000100:00100000:2.0:1789428066.079460:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155392 00000100:00100000:2.0:1789428066.079464:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155392 00000100:00100000:2.0:1789428066.079483:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428066.079495:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:20180:x1876350940155264:12345-0@lo:104: 00010000:00010000:2.0:1789428066.079511:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.079517:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155136 00010000:00010000:2.0:1789428066.079576:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428066.079583:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+5:20180:x1876350940155264:12345-0@lo:104: Request processed in 91us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428066.079591:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428066.079610:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428066.079617:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:20180:x1876350940155392:12345-0@lo:104: 00010000:00010000:2.0:1789428066.079626:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.079671:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789428066.079676:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+4:20180:x1876350940155392:12345-0@lo:104: Request processed in 60us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428066.079692:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428066.079706:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428066.079712:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:20180:x1876350940155136:12345-0@lo:104: 00010000:00010000:2.0:1789428066.079719:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.079745:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789428066.079749:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:20180:x1876350940155136:12345-0@lo:104: Request processed in 39us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428066.079755:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789428066.079842:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789428066.079850:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.079858:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428066.079863:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.079882:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428066.079890:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428066.079896:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789428066.080124:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080129:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428066.080133:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428066.080161:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080170:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1f400/0x84fc867ede51966b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519672 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080185:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428066.080189:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080194:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428066.080198:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080203:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428066.080209:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428066.080220:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789428066.080235:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080240:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428066.080247:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080253:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede5197c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede5197d0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.080263:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428066.080265:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428066.080267:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428066.080280:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940155520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428066.080477:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428066.080485:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080493:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc118ec20) 00010000:00010000:3.0:1789428066.080495:0:20180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428066.080496:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080504:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.080509:0:20180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 23 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428066.080510:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428066.080516:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789428066.080520:0:20180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155776:0@lo:104: 00010000:00010000:1.0:1789428066.080536:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080542:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789428066.080556:0:20180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428066.080567:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080573:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede51962c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519633 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.080583:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428066.080584:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428066.080586:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940155904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428066.080586:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428066.080590:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428066.080592:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428066.080613:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428066.080669:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155776 00000100:00100000:3.0:1789428066.080674:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155776 00000100:00100000:1.0:1789428066.080686:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155904 00000100:00100000:1.0:1789428066.080690:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155904 00000100:00100000:3.0:1789428066.080704:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789428066.080708:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 24 pid: 17153 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.080711:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:20180:x1876350940155776:12345-0@lo:104: 00010000:00010000:3.0:1789428066.080720:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.080728:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428066.080733:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940155904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428066.080745:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428066.080750:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 24 pid: 17153 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428066.080756:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789428066.080761:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+3:20180:x1876350940155776:12345-0@lo:104: Request processed in 51us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1789428066.080761:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 24 pid: 17153 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.080768:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789428066.080784:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428066.080799:0:20180:0:(client.c:2716:ptlrpc_set_wait()) set ffff91958252da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428066.080821:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940155904:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428066.080830:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155136:0@lo:104: 00000100:00100000:1.0:1789428066.080833:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789428066.080846:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940155904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428066.080872:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155264:0@lo:104: 00010000:00010000:3.0:1789428066.080881:0:20180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813edc00/0x84fc867ede519633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51962c expref: 23 pid: 17153 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.080893:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155392:0@lo:104: 00000100:00100000:0.0:1789428066.081237:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.081267:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428066.081274:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940155648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428066.081358:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428066.081388:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428066.081394:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.081401:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428066.081405:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.081472:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428066.081487:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428066.081493:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789428066.081516:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.081523:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789428066.081533:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155520 00010000:00010000:0.0:1789428066.081538:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.081539:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155520 00010000:00010000:0.0:1789428066.081545:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed800/0x84fc867ede51961e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519625 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.081555:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.081561:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428066.081563:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428066.081564:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428066.081571:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940155648 00000100:00100000:0.0:1789428066.081573:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c098993-d5b4-48be-b0c2-bdb904c28b81:3614:1876350940156032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428066.081574:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940155648 00010000:00010000:1.0:1789428066.081589:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 24 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428066.081597:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428066.081600:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156032 00000100:00100000:1.0:1789428066.081602:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156032 00010000:00010000:1.0:1789428066.081612:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 25 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.081624:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428066.081631:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+25:3615:x1876350940155520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428066.081640:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428066.081645:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 25 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.081654:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 25 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.081664:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375dc00/0x84fc867ede519672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51966b expref: 25 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428066.081667:0:17145:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789428066.081675:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428066.081678:0:17145:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789428066.081702:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3615:x1876350940155520:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428066.081704:0:17146:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789428066.081712:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428066.081716:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428066.081718:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3615:x1876350940155648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428066.081726:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789428066.081728:0:17144:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789428066.081731:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.081734:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428066.081739:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:3614:x1876350940156032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428066.081741:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.081751:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209400/0x84fc867ede5197d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede5197c9 expref: 23 pid: 17152 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.081759:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789428066.081760:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428066.081764:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 22 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.081773:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 22 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428066.081781:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:3615:x1876350940155648:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (424us total) trans 0 rc 0/0 00010000:00010000:1.0:1789428066.081782:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428066.081797:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428066.081801:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:3614:x1876350940156032:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428066.081807:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789428066.081878:0:20180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e400/0x84fc867ede519625 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51961e expref: 20 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428066.081889:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155776:0@lo:104: 00000100:00100000:0.0:1789428066.082246:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c098993-d5b4-48be-b0c2-bdb904c28b81:3614:1876350940156032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428066.082275:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940155648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428066.082283:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940155520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428066.084666:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428066.084705:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428066.084772:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694848 00000100:00100000:2.0:1789428066.084784:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694848 00010000:00010000:2.0:1789428066.084828:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 13 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428066.084866:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931694976 00000100:00100000:2.0:1789428066.084869:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931694976 00010000:00010000:2.0:1789428066.084883:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428066.084919:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1789428066.084929:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+14:2397:x1876350931694848:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428066.084947:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428066.084954:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.084968:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428066.084995:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428066.085101:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:0.0:1789428066.085112:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+14:2396:x1876350931694976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428066.085121:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428066.085142:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085151:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085164:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.085171:0:20180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429c00/0x84fc867ede51995f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fac expref: 14 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085175:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.085185:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940154880:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789428066.085194:0:17144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085202:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.085210:0:20180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46400/0x84fc867ede519920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f3c expref: 13 pid: 17151 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085210:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428066.085219:0:20180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20180:1876350940155008:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789428066.085219:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085226:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428066.085231:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085240:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085249:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428066.085264:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789428066.085332:0:20180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.085343:0:20180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.085357:0:20180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428066.085363:0:20180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375de00/0x84fc867ede519990 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428066.085615:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:2397:x1876350931694848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 686us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428066.085624:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1789428066.085745:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:2396:x1876350931694976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 636us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.085752:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1789428066.096758:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789428066.096791:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940156288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428066.096886:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428066.096929:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940156160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789428066.096953:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428066.096990:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156288 00000100:00100000:1.0:1789428066.097000:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156288 00000100:00100000:1.0:1789428066.097057:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156160 00000100:00100000:1.0:1789428066.097061:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156160 00000100:00100000:1.0:1789428066.097082:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789428066.097091:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940156288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428066.097129:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789428066.097181:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940156288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428066.097188:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789428066.097210:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789428066.097216:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940156160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789428066.097226:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789428066.098238:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940156160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1015us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428066.098279:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789428066.098435:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789428066.098484:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940156288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428066.098506:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940156160:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789428066.100600:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428066.101204:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940156800:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101688:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101731:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940157312:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101758:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101787:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789428066.101794:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940156416:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101823:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101844:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940156928:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101867:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101899:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940156544:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101923:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101942:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940157056:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.101962:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.101975:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789428066.101981:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940156672:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.102003:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.102401:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940157184:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.102453:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428066.102522:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156800 00000100:00100000:0.0:1789428066.102533:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156800 00000100:00100000:0.0:1789428066.102597:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157312 00000100:00100000:0.0:1789428066.102601:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157312 00000100:00100000:0.0:1789428066.102639:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156928 00000100:00100000:0.0:1789428066.102642:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156928 00000100:00100000:0.0:1789428066.102656:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156544 00000100:00100000:0.0:1789428066.102660:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156544 00000100:00100000:0.0:1789428066.102672:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157056 00000100:00080000:1.0:1789428066.102675:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428066.102675:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157056 00000100:00080000:1.0:1789428066.102679:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428066.102688:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157184 00000100:00100000:0.0:1789428066.102691:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157184 00000100:00100000:0.0:1789428066.102724:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428066.102735:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940156800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789428066.102740:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428066.102813:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940156800:12345-0@lo:400:kworker.0 Request processed in 79us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.102822:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428066.102842:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428066.102848:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940157312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.102873:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940157312:12345-0@lo:400:kworker.0 Request processed in 27us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.102879:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428066.102888:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428066.102893:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940156928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.102914:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940156928:12345-0@lo:400:kworker.0 Request processed in 20us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.102919:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428066.102928:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428066.102933:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940156544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.102986:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940156544:12345-0@lo:400:kworker.0 Request processed in 52us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.102997:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789428066.103001:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940156928:0@lo:400:kworker.0 00000100:00100000:1.0:1789428066.103014:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940156800:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.103026:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789428066.103032:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940157056:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789428066.103035:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ff9500 x1876350940157312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428066.103047:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940157312:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.103068:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940157056:12345-0@lo:400:kworker.0 Request processed in 36us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.103074:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789428066.103088:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789428066.103095:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940157184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.103120:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940157184:12345-0@lo:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.103127:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789428066.103153:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156416 00000100:00100000:0.0:1789428066.103157:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156416 00000100:00100000:0.0:1789428066.103189:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940156672 00000100:00100000:0.0:1789428066.103193:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940156672 00000100:00100000:0.0:1789428066.103206:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428066.103212:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940156416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.103261:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940156416:12345-0@lo:400:kworker.0 Request processed in 49us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.103268:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428066.103279:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428066.103286:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940156672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.106530:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940156672:12345-0@lo:400:kworker.0 Request processed in 3230us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428066.106550:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428066.106679:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940156672:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.106695:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940157184:0@lo:400:kworker.0 00000100:00100000:0.0:1789428066.106709:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940156544:0@lo:400:kworker.0 00010000:00080000:0.0:1789428066.106728:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583ff9f80 x1876350940157056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428066.106739:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940157056:0@lo:400:kworker.0 00000100:00100000:1.0:1789428066.106763:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940156416:0@lo:400:kworker.0 00000040:00080000:1.0:1789428066.353405:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428067.056577:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428067.120592:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428067.120625:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940157440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428067.120724:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428067.120798:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157440 00000100:00100000:0.0:1789428067.120810:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157440 00000100:00100000:0.0:1789428067.120883:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428067.120894:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940157440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428067.120941:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428067.120996:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940157440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.121005:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428067.121062:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940157440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428067.121321:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940157568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428067.121353:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428067.121512:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157568 00000100:00100000:3.0:1789428067.121518:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157568 00000100:00100000:3.0:1789428067.121558:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789428067.121566:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940157568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428067.121591:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789428067.121640:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940157568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428067.121648:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789428067.121716:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940157568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789428067.366666:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428067.366920:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695104 00000100:00100000:1.0:1789428067.366936:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695104 00000100:00100000:1.0:1789428067.367041:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 145 00000100:00100000:1.0:1789428067.367055:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:14882:x1876350931695104:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428067.367079:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428067.367106:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46400/0x84fc867ede519997 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300fe4 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.367144:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46400/0x84fc867ede519997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fe4 expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.367178:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46400/0x84fc867ede519997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fe4 expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.367189:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46400, rc 0) 00000100:00100000:1.0:1789428067.367275:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695104:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 222us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.367283:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 145 00000100:00100000:3.0:1789428067.381838:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428067.382069:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695232 00000100:00100000:1.0:1789428067.382083:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695232 00000100:00100000:1.0:1789428067.382154:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:1.0:1789428067.382166:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695232:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428067.382550:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695232:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 385us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.382559:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:0.0:1789428067.385069:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428067.385212:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695360 00000100:00100000:1.0:1789428067.385224:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695360 00000100:00100000:1.0:1789428067.385289:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:1.0:1789428067.385303:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695360:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428067.385659:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695360:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 358us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.385669:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:2.0:1789428067.398790:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428067.399067:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695488 00000100:00100000:3.0:1789428067.399082:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695488 00000100:00100000:3.0:1789428067.399292:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:3.0:1789428067.399306:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:14882:x1876350931695488:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428067.399340:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428067.399367:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91958375d000/0x84fc867ede51999e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7300feb expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.399442:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91958375d000/0x84fc867ede51999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300feb expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.400384:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91958375d000/0x84fc867ede51999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300feb expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.400409:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375d000, rc 0) 00000100:00100000:3.0:1789428067.400546:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:14882:x1876350931695488:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 1242us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428067.400555:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:2.0:1789428067.415222:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428067.416020:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695616 00000100:00100000:1.0:1789428067.416034:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695616 00000100:00100000:1.0:1789428067.416107:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:1.0:1789428067.416118:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:14882:x1876350931695616:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428067.416346:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:14882:x1876350931695616:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 230us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.416352:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:0.0:1789428067.419370:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428067.419563:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695744 00000100:00100000:3.0:1789428067.419576:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695744 00000100:00100000:3.0:1789428067.419637:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:3.0:1789428067.419649:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:14882:x1876350931695744:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.419831:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bceea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:14882:x1876350931695744:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 184us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428067.419839:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 150 10000000:01000000:2.0:1789428067.507747:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789428067.507794:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583041800 from 13 10000000:01000000:2.0:1789428067.507802:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789428067.507871:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.507886:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.507901:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.507935:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.508036:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.508102:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428067.508262:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157696 00000100:00100000:3.0:1789428067.508274:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157696 00000100:00100000:3.0:1789428067.508350:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789428067.508363:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:17156:x1876350940157696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428067.508394:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428067.508531:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209600/0x84fc867ede5199ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5199a5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.508578:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209600/0x84fc867ede5199ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5199a5 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.508593:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209600/0x84fc867ede5199ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5199a5 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.508603:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209600, rc 0) 00000100:00100000:0.0:1789428067.508692:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940157696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.508701:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789428067.509251:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428067.509275:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.509287:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.509387:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.509483:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.509516:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428067.509682:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157824 00000100:00100000:1.0:1789428067.509688:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157824 00000100:00100000:1.0:1789428067.509733:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789428067.509743:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940157824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428067.509922:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940157824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.509931:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789428067.510139:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.510196:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.510248:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.510270:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428067.510316:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940157952 00000100:00100000:0.0:1789428067.510330:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940157952 00000100:00100000:0.0:1789428067.510522:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789428067.510534:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940157952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428067.510701:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940157952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.510708:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789428067.510798:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940157952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428067.513921:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789428067.527123:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789428067.527181:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789428067.527197:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.527228:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428067.527514:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428067.527520:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196b5b09800 from 13 10000000:01000000:0.0:1789428067.527525:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428067.527652:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.527663:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.527678:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428067.527726:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428067.528518:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428067.528900:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428067.529752:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158080 00000100:00100000:1.0:1789428067.529778:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158080 00000100:00100000:1.0:1789428067.529860:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789428067.529873:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:17156:x1876350940158080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428067.529896:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428067.529920:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47400/0x84fc867ede5199ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5199b3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.529957:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47400/0x84fc867ede5199ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5199b3 expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.529984:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47400/0x84fc867ede5199ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5199b3 expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428067.529997:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47400, rc 0) 00000100:00100000:1.0:1789428067.530090:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.530098:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789428067.530376:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428067.530408:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.530449:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.532103:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.532196:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.532667:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428067.537452:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158208 00000100:00100000:0.0:1789428067.537471:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158208 00000100:00100000:0.0:1789428067.537674:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789428067.537687:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428067.537926:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.537935:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789428067.538503:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.538580:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.538649:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428067.550321:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b6628000 going to sleep for 11 seconds 00000100:00100000:1.0:1789428067.552380:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158336 00000100:00100000:1.0:1789428067.552425:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158336 00000100:00100000:1.0:1789428067.552530:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789428067.552556:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428067.553394:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 848us (14738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428067.553445:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789428067.559903:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789428067.561547:0:20255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789428067.561861:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789428067.561892:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428067.561904:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.561916:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428067.561926:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789428067.561929:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919698b0d800 from 13 10000000:01000000:2.0:1789428067.561932:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789428067.561969:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.561978:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.562001:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.562121:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.562192:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.562240:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428067.562313:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158464 00000100:00100000:0.0:1789428067.562330:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158464 00000100:00100000:0.0:1789428067.562458:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789428067.562475:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:17156:x1876350940158464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428067.562498:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428067.562519:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208c00/0x84fc867ede5199c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5199c1 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.562678:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208c00/0x84fc867ede5199c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5199c1 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.562694:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208c00/0x84fc867ede5199c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5199c1 expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.562704:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208c00, rc 0) 00000100:00100000:0.0:1789428067.562860:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 390us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.562881:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789428067.563051:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428067.563073:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.563084:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.563176:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.563226:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.563259:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428067.563642:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158592 00000100:00100000:0.0:1789428067.563650:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158592 00000100:00100000:0.0:1789428067.563687:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789428067.563697:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428067.564492:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 795us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.564502:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789428067.564692:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.564740:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.564809:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.564839:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:2.0:1789428067.564855:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158720 00000100:00100000:2.0:1789428067.564860:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158720 00000100:00100000:2.0:1789428067.570691:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789428067.570721:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.571656:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 945us (6843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428067.571675:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789428067.571914:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789428067.573893:0:20257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789428067.573957:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789428067.573982:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789428067.573993:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.574005:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428067.574015:0:17156:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789428067.574018:0:17156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bfad4800 from 13 10000000:01000000:3.0:1789428067.574021:0:17156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789428067.575651:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.575668:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.575681:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428067.575711:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.575788:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428067.578378:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b6628900 going to sleep for 11 seconds 00000100:00100000:0.0:1789428067.579681:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158848 00000100:00100000:0.0:1789428067.579749:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158848 00000100:00100000:0.0:1789428067.580078:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789428067.580091:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:17156:x1876350940158848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428067.580116:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428067.580140:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209c00/0x84fc867ede5199d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede5199cf expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.580178:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209c00/0x84fc867ede5199d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede5199cf expref: 24 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.582389:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209c00/0x84fc867ede5199d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede5199cf expref: 24 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428067.582446:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209c00, rc 0) 00000100:00100000:0.0:1789428067.582586:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940158848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2497us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428067.582596:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789428067.587527:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428067.587993:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428067.588012:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428067.588137:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.589008:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.589079:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428067.589159:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940158976 00000100:00100000:3.0:1789428067.589175:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940158976 00000100:00100000:3.0:1789428067.589242:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789428067.589253:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940158976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.589465:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940158976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428067.589473:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789428067.589679:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.589737:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940159104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428067.590444:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428067.590487:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:2.0:1789428067.590516:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940159104 00000100:00100000:2.0:1789428067.590526:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940159104 00000100:00100000:3.0:1789428067.590785:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789428067.590799:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940159104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428067.590922:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:17156:x1876350940159104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428067.590926:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789428067.590975:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c098993-d5b4-48be-b0c2-bdb904c28b81:17156:1876350940159104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428067.592193:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789428067.593971:0:17156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789428067.594021:0:17156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789428067.594044:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428067.594056:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428068.017100:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789428068.090861:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428069.001500:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.001585:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931695872 00000100:00100000:0.0:1789428069.001594:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931695872 00000100:00100000:0.0:1789428069.001660:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789428069.001668:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:15553:x1876350931695872:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789428069.001686:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.001703:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede5199dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ff2 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001758:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001768:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001778:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001787:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001791:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001795:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001857:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001861:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001877:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428069.001901:0:17160:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428069.001904:0:17160:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428069.001942:0:17160:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001950:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001954:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001959:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001963:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.001965:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001970:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001978:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:0.0:1789428069.001981:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.001984:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.001987:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede5199e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002003:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002007:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002010:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002013:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.002015:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002018:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002500:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9196a235f600) 00010000:00010000:0.0:1789428069.002502:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.002506:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002512:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede5199eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002546:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede5199dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff2 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002559:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff2 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.002583:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789428069.002584:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428069.002586:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208e00, rc 0) 00000100:00100000:0.0:1789428069.002633:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:15553:x1876350931695872:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 967us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.002638:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00080000:1.0:1789428069.002998:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428069.010452:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.010564:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696000 00000100:00100000:1.0:1789428069.010575:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696000 00000100:00100000:1.0:1789428069.010622:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:1.0:1789428069.010630:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:15553:x1876350931696000:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789428069.010706:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:15553:x1876350931696000:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428069.010712:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789428069.023663:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.024139:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696256 00000100:00100000:1.0:1789428069.024151:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696256 00000100:00100000:1.0:1789428069.024227:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:1.0:1789428069.024252:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:15553:x1876350931696256:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789428069.024276:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428069.024302:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5199f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7300ff9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024395:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024410:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024462:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024478:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024486:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024493:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024604:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519a0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024612:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519a0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024620:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519a0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428069.024643:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789428069.024790:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024798:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024805:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024810:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428069.024814:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024821:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024834:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:1.0:1789428069.024836:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428069.024842:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024847:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e400/0x84fc867ede519a00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024859:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024864:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024878:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024883:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428069.024886:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024891:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024898:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919581d4e900) 00010000:00010000:1.0:1789428069.024900:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428069.024903:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.024908:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1f400/0x84fc867ede519a07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.029035:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47a00/0x84fc867ede5199f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff9 expref: 10 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.029068:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519a0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff9 expref: 9 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428069.029076:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d4ea00) 00010000:00010000:1.0:1789428069.029079:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428069.029082:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fe00, rc 0) 00000100:00100000:1.0:1789428069.029176:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15553:x1876350931696256:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 4925us (5521us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789428069.029201:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789428069.032305:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.032470:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696384 00000100:00100000:0.0:1789428069.032482:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696384 00000100:00100000:0.0:1789428069.032539:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1789428069.032550:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15553:x1876350931696384:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789428069.032672:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15553:x1876350931696384:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 123us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.032679:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789428069.035224:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.038084:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696512 00000100:00100000:1.0:1789428069.038104:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696512 00000100:00100000:1.0:1789428069.038202:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:1.0:1789428069.038215:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15553:x1876350931696512:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789428069.039083:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789428069.041554:0:17159:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3083us 00000100:00100000:3.0:1789428069.050762:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.051474:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696640 00000100:00100000:0.0:1789428069.051486:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696640 00000100:00100000:0.0:1789428069.051552:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1789428069.051563:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15559:x1876350931696640:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428069.051583:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.051604:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301000 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051674:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051698:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051708:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051723:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051729:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051735:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051774:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051780:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051786:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051791:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.051794:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051801:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051811:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:0.0:1789428069.051820:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.051837:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051843:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051854:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051858:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051863:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051867:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.051870:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051875:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051882:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9196a235f600) 00010000:00010000:0.0:1789428069.051885:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.051888:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051893:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051922:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519a1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301000 expref: 10 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051938:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:0.0:1789428069.051940:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.051944:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301000 expref: 10 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.051954:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209000, rc 0) 00000100:00100000:0.0:1789428069.052029:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15559:x1876350931696640:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 467us (1273us total) trans 0 rc 301/301 00000100:00100000:0.0:1789428069.052037:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1789428069.052451:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15553:x1876350931696512:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 14238us (17234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428069.052459:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:3.0:1789428069.060218:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.060473:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931696768 00000100:00100000:0.0:1789428069.060485:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931696768 00000100:00100000:0.0:1789428069.060536:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1789428069.060547:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15559:x1876350931696768:12345-192.168.202.24@tcp:700:lfs.0 00000100:00100000:0.0:1789428069.060623:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15559:x1876350931696768:12345-192.168.202.24@tcp:700:lfs.0 Request processed in 79us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.060630:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1789428069.063467:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.063583:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697024 00000100:00100000:2.0:1789428069.063593:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697024 00000100:00100000:2.0:1789428069.063651:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:2.0:1789428069.063660:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:15559:x1876350931697024:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:2.0:1789428069.063729:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428069.063756:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede51994a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f6d expref: 9 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.063775:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:2.0:1789428069.063780:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428069.063849:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.063862:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 5 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.063871:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.063905:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 5 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.063919:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 5 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428069.063933:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17161:1876350940159232:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428069.064012:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428069.066810:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.066892:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17161:1876350940159232:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428069.066918:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428069.067017:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697152 00000100:00100000:3.0:1789428069.067025:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697152 00010000:00010000:3.0:1789428069.067080:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 6 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428069.067115:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1789428069.067124:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2397:x1876350931697152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428069.067238:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428069.067247:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 6 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067259:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 6 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067284:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fdd expref: 6 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067305:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:3.0:1789428069.067311:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067319:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067327:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.067394:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428069.067489:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931697152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 365us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.067496:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:1.0:1789428069.068100:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789428069.070044:0:17161:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.070073:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.071379:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.071407:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.071590:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073767:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073790:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073800:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789428069.073819:0:17161:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e4374c4 reply state 00000000867807ed transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073830:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073838:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789428069.073841:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789428069.073845:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789428069.073851:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789428069.073867:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073874:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073880:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073886:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428069.073890:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073898:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073908:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919583550000) 00010000:00010000:2.0:1789428069.073911:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428069.073915:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073921:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789428069.073942:0:17161:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e4374c4 reply state 00000000867807ed transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073954:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.073961:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919581d49000) 00010000:00010000:2.0:1789428069.073964:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789428069.073976:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789428069.074143:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+10:15559:x1876350931697024:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 10465us (10665us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789428069.074154:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00010000:00010000:0.0:1789428069.104778:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428069.159358:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.159762:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697280 00000100:00100000:3.0:1789428069.159773:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697280 00000100:00100000:3.0:1789428069.159842:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:3.0:1789428069.159853:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+10:15567:x1876350931697280:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:3.0:1789428069.159877:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428069.159901:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301007 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.159974:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.159987:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.159999:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428069.160040:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789428069.160044:0:17159:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789428069.160078:0:17159:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.160100:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301007 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.160118:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301007 expref: 11 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.160155:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:3.0:1789428069.160158:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789428069.160162:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375de00, rc 0) 00000100:00100000:3.0:1789428069.160986:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+11:15567:x1876350931697280:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 1131us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.160996:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:3.0:1789428069.182984:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.183366:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697408 00000100:00100000:0.0:1789428069.183377:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697408 00000100:00100000:0.0:1789428069.183775:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789428069.183787:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:15568:x1876350931697408:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428069.183818:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.183853:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730100e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.183948:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.183962:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.183984:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428069.184025:0:17160:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428069.184029:0:17160:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428069.184052:0:17160:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.184077:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519a54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730100e expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.184095:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730100e expref: 6 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.184105:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:0.0:1789428069.184108:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428069.184112:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209400, rc 0) 00000100:00100000:0.0:1789428069.184189:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15568:x1876350931697408:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 404us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.184196:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:1.0:1789428069.187931:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.188111:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697536 00000100:00100000:2.0:1789428069.188122:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697536 00000100:00100000:2.0:1789428069.188223:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1789428069.188235:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:15568:x1876350931697536:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428069.188254:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.188274:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301015 expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188334:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188347:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188357:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188368:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188374:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188380:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188506:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188538:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188547:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.188594:0:19948:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428069.188598:0:19948:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428069.188620:0:19948:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188633:0:19948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188640:0:19948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188646:0:19948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188652:0:19948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428069.188656:0:19948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188664:0:19948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188675:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:2.0:1789428069.188678:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428069.188683:0:19948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188700:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188713:0:19948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188718:0:19948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188724:0:19948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188729:0:19948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428069.188732:0:19948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188738:0:19948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188746:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919581d49000) 00010000:00010000:2.0:1789428069.188749:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428069.188752:0:19948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188757:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519a70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188781:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519a62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301015 expref: 8 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188807:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301015 expref: 7 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.188814:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789428069.188816:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428069.188818:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789428069.188885:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+7:15568:x1876350931697536:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 652us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.188892:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1789428069.202355:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.202564:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697664 00000100:00100000:2.0:1789428069.202700:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697664 00000100:00100000:2.0:1789428069.202775:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1789428069.202786:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:15568:x1876350931697664:12345-192.168.202.24@tcp:900:lfs.0 00000100:00100000:2.0:1789428069.202879:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:15568:x1876350931697664:12345-192.168.202.24@tcp:900:lfs.0 Request processed in 95us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.202886:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00080000:1.0:1789428069.203008:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428069.207312:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.207398:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931697920 00000100:00100000:2.0:1789428069.207409:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931697920 00000100:00100000:2.0:1789428069.207499:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:2.0:1789428069.207509:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+7:15568:x1876350931697920:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428069.207541:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.207565:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730101c expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.207830:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789428069.207952:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730101c expref: 9 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.207966:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:2.0:1789428069.207970:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428069.207976:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730101c expref: 9 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.207989:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429e00, rc 0) 00000100:00100000:2.0:1789428069.208041:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+8:15568:x1876350931697920:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 534us (739us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789428069.208048:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:1.0:1789428069.211029:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.216019:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931698176 00000100:00100000:3.0:1789428069.216033:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931698176 00000100:00100000:2.0:1789428069.216259:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1789428069.216271:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+8:15568:x1876350931698176:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:2.0:1789428069.216331:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428069.216358:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301015 expref: 8 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.216378:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789428069.216394:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428069.216455:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.216469:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.216479:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789428069.217071:0:17159:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000955191e6 reply state 00000000e248f6fe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.217137:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.217145:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789428069.217148:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789428069.217151:0:17159:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789428069.217169:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789428069.217292:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+9:15568:x1876350931698176:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 1022us (6273us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789428069.217300:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1789428069.222044:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.222113:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931698432 00000100:00100000:3.0:1789428069.222124:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931698432 00000100:00100000:3.0:1789428069.222186:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:3.0:1789428069.222197:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+9:15568:x1876350931698432:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1789428069.222574:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+10:15568:x1876350931698432:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 378us (539us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789428069.222582:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:0.0:1789428069.231011:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.231401:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931698688 00000100:00100000:2.0:1789428069.231531:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931698688 00000100:00100000:2.0:1789428069.231601:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1789428069.231614:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+10:15568:x1876350931698688:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428069.231646:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.231675:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301023 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231774:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231792:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231808:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231835:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231843:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.231850:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.231985:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789428069.233297:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233371:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233389:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233396:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428069.233402:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233412:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233515:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:2.0:1789428069.233520:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428069.233527:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233556:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233579:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233585:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233591:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233596:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428069.233599:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233605:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233613:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919581d49000) 00010000:00010000:2.0:1789428069.233616:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428069.233619:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233624:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519aa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233692:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301023 expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233715:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:2.0:1789428069.233717:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428069.233721:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede519a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301023 expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.233732:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789428069.233838:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+11:15568:x1876350931698688:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2224us (2839us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789428069.233848:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1789428069.237201:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.237284:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931698816 00000100:00100000:3.0:1789428069.237297:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931698816 00000100:00100000:3.0:1789428069.237378:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:3.0:1789428069.237399:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+11:15568:x1876350931698816:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1789428069.237453:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428069.237480:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519aaf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730102a expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237597:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237629:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237643:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428069.237671:0:19948:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789428069.237675:0:19948:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789428069.237696:0:19948:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237724:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519aaf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 13 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237746:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 12 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.237756:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:3.0:1789428069.237759:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789428069.237763:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91958375da00, rc 0) 00000100:00100000:3.0:1789428069.237845:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+12:15568:x1876350931698816:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 447us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.237852:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:1.0:1789428069.252305:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.252783:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931698944 00000100:00100000:3.0:1789428069.252794:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931698944 00000100:00100000:3.0:1789428069.252890:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1789428069.252902:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+12:15568:x1876350931698944:12345-192.168.202.24@tcp:37:lfs.0 00000100:00100000:3.0:1789428069.259369:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+12:15568:x1876350931698944:12345-192.168.202.24@tcp:37:lfs.0 Request processed in 6458us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.259402:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:2.0:1789428069.264699:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.264806:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699200 00000100:00100000:1.0:1789428069.264817:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699200 00000100:00100000:1.0:1789428069.264913:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789428069.264937:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583d23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+12:15568:x1876350931699200:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789428069.265238:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583d23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+13:15568:x1876350931699200:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 315us (677us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789428069.265247:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1789428069.321971:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.322100:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699328 00000100:00100000:0.0:1789428069.322109:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699328 00000100:00100000:0.0:1789428069.322185:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1789428069.322193:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+11:15574:x1876350931699328:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789428069.322219:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.322238:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301031 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322299:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322314:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322325:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322333:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322338:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322343:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322477:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322483:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322502:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428069.322535:0:17160:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428069.322539:0:17160:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428069.322589:0:17160:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322601:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322605:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322610:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322613:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.322616:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322622:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322631:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:0.0:1789428069.322632:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.322636:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322639:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519ac4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322656:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322660:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322664:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322666:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428069.322668:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322671:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322675:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919581d49000) 00010000:00010000:0.0:1789428069.322676:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428069.322678:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322681:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519acb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322698:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301031 expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322706:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301031 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.322721:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:0.0:1789428069.322724:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789428069.322727:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208000, rc 0) 00000100:00100000:0.0:1789428069.322785:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+12:15574:x1876350931699328:12345-192.168.202.24@tcp:101:bash.0 Request processed in 592us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.322792:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1789428069.325914:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.326015:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699456 00000100:00100000:2.0:1789428069.326024:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699456 00000100:00100000:2.0:1789428069.326110:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789428069.326121:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15574:x1876350931699456:12345-192.168.202.24@tcp:900:bash.0 00000100:00100000:2.0:1789428069.326218:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15574:x1876350931699456:12345-192.168.202.24@tcp:900:bash.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.326226:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789428069.329040:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.329494:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699712 00000100:00100000:3.0:1789428069.329504:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699712 00000100:00100000:3.0:1789428069.329619:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:3.0:1789428069.329630:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+12:15574:x1876350931699712:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789428069.329650:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428069.329671:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519ad9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301038 expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.329777:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.329794:0:19948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 12 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.329815:0:19948:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.329853:0:19948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 12 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.329867:0:19948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 12 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428069.329882:0:19948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19948:1876350940159360:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428069.329973:0:19948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b6628300 going to sleep for 11 seconds 00000100:00100000:3.0:1789428069.334122:0:19948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19948:1876350940159360:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428069.334165:0:19948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428069.334554:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.334929:0:20183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699840 00000100:00100000:2.0:1789428069.334937:0:20183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699840 00010000:00010000:2.0:1789428069.334978:0:20183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 13 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428069.335019:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789428069.335038:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+13:2396:x1876350931699840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428069.335054:0:20183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428069.335061:0:20183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 13 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335075:0:20183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 13 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335099:0:20183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375da00/0x84fc867ede519ab6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730102a expref: 13 pid: 19948 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335117:0:20183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:2.0:1789428069.335123:0:20183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335132:0:20183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335140:0:20183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.335163:0:20183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428069.335236:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+12:2396:x1876350931699840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 198us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.335244:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00010000:00010000:3.0:1789428069.335606:0:19948:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.335614:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.335638:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.335648:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.335656:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336175:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336182:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336188:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428069.336195:0:19948:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789428069.336224:0:19948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336229:0:19948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336244:0:19948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336248:0:19948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428069.336251:0:19948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336256:0:19948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336263:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:3.0:1789428069.336265:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428069.336268:0:19948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336272:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375c400/0x84fc867ede519ae0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789428069.336279:0:19948:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be1b68e5 reply state 000000000f78271f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336286:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336290:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9196989f7b00) 00010000:00010000:3.0:1789428069.336291:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789428069.336293:0:19948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789428069.336320:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375dc00/0x84fc867ede519ad9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 15 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336330:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 14 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.336339:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:3.0:1789428069.336340:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789428069.336341:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8800, rc 0) 00000100:00100000:3.0:1789428069.336389:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+15:15574:x1876350931699712:12345-192.168.202.24@tcp:101:bash.0 Request processed in 6754us (7359us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789428069.336396:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:3.0:1789428069.360182:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.360797:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931699968 00000100:00100000:2.0:1789428069.360867:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931699968 00000100:00100000:2.0:1789428069.361046:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789428069.361058:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+15:15574:x1876350931699968:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789428069.361097:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.361120:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519afc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730103f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361181:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361195:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361277:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.361339:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789428069.361343:0:17161:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428069.361372:0:17161:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361391:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361433:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519afc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361453:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.361462:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.361465:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789428069.361469:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429a00, rc 0) 00000100:00100000:2.0:1789428069.361572:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:15574:x1876350931699968:12345-192.168.202.24@tcp:101:bash.0 Request processed in 517us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.361580:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:1.0:1789428069.365614:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.365665:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931700224 00000100:00100000:3.0:1789428069.365674:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931700224 00000100:00100000:3.0:1789428069.365728:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:3.0:1789428069.365737:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:15574:x1876350931700224:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:3.0:1789428069.366011:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:15574:x1876350931700224:12345-192.168.202.24@tcp:35:bash.0 Request processed in 273us (402us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789428069.366019:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000040:00080000:1.0:1789428069.426199:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789428069.449937:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.450116:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931700480 00000100:00100000:2.0:1789428069.450127:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931700480 00000100:00100000:2.0:1789428069.450220:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789428069.450231:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:15584:x1876350931700480:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428069.450254:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.450274:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301046 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.450396:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789428069.450508:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301046 expref: 19 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.450523:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:2.0:1789428069.450526:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428069.450531:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301046 expref: 19 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.450543:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429e00, rc 0) 00000100:00100000:2.0:1789428069.450606:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+18:15584:x1876350931700480:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 376us (679us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789428069.450613:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1789428069.459665:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.459795:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931700736 00000100:00100000:1.0:1789428069.459805:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931700736 00000100:00100000:1.0:1789428069.459860:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:1.0:1789428069.459871:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+18:15584:x1876350931700736:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789428069.460091:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15584:x1876350931700736:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 220us (434us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789428069.460099:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:1.0:1789428069.497668:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.497929:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931700992 00000100:00100000:0.0:1789428069.497940:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931700992 00000100:00100000:0.0:1789428069.498006:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:0.0:1789428069.498017:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15587:x1876350931700992:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428069.498041:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.498062:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519b18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730104d expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.498172:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519b1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.498187:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519b1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.498200:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519b1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428069.498210:0:17160:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428069.498296:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209e00/0x84fc867ede519b18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730104d expref: 22 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.498331:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519b1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730104d expref: 21 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.498340:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428069.498343:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789428069.498347:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208600, rc 0) 00000100:00100000:0.0:1789428069.498464:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+21:15587:x1876350931700992:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 448us (808us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789428069.498472:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789428069.503610:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.503658:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.503761:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931701120 00000100:00100000:3.0:1789428069.503773:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931701120 00000100:00100000:0.0:1789428069.503830:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931701248 00000100:00100000:3.0:1789428069.503833:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:0.0:1789428069.503835:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931701248 00000100:00100000:3.0:1789428069.503842:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15587:x1876350931701120:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1789428069.503912:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.503982:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.503995:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504042:0:19948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504049:0:19948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504056:0:19948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504062:0:19948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e8600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428069.504067:0:19948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504073:0:19948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504085:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:3.0:1789428069.504088:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789428069.504092:0:19948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.504098:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428069.504182:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15587:x1876350931701120:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 340us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.504190:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:0.0:1789428069.504973:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1789428069.504984:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+21:2394:x1876350931701248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428069.504999:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428069.505015:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519b1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730104d expref: 21 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.505027:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428069.505030:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428069.505069:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+20:2394:x1876350931701248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.505076:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789428069.511065:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428069.511693:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931701504 00000100:00100000:1.0:1789428069.511704:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931701504 00000100:00100000:1.0:1789428069.511799:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789428069.511810:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+20:15587:x1876350931701504:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789428069.512028:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+21:15587:x1876350931701504:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 220us (971us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789428069.512036:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1789428069.740995:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.741119:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931701760 00000100:00100000:2.0:1789428069.741131:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931701760 00000100:00100000:2.0:1789428069.741472:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:2.0:1789428069.741484:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+21:15618:x1876350931701760:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:2.0:1789428069.741510:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.741533:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b34 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301054 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.741639:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.741653:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.741667:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428069.741678:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789428069.741798:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b34 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301054 expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.741817:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301054 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.741825:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.741828:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789428069.741832:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428200, rc 0) 00000100:00100000:2.0:1789428069.741963:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15618:x1876350931701760:12345-192.168.202.24@tcp:101:cat.0 Request processed in 481us (978us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789428069.741984:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:2.0:1789428069.746615:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.746725:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702016 00000100:00100000:3.0:1789428069.746736:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702016 00000100:00100000:3.0:1789428069.746814:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1789428069.746824:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15618:x1876350931702016:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:3.0:1789428069.747118:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:15618:x1876350931702016:12345-192.168.202.24@tcp:35:cat.0 Request processed in 295us (512us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789428069.747127:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789428069.748000:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.748057:0:20183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702144 00000100:00100000:2.0:1789428069.748063:0:20183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702144 00000100:00100000:2.0:1789428069.748116:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:2.0:1789428069.748125:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:2396:x1876350931702144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428069.748136:0:20183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428069.748174:0:20183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301054 expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.748191:0:20183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.748195:0:20183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428069.751036:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:2396:x1876350931702144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2900us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.751054:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:0.0:1789428069.804372:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.804546:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702400 00000100:00100000:2.0:1789428069.804557:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702400 00000100:00100000:2.0:1789428069.804671:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:2.0:1789428069.804682:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15624:x1876350931702400:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789428069.804709:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.804730:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730105b expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804881:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804896:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804912:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804921:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804967:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.804994:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 24 pid: 17161 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428069.805008:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940159488:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428069.805112:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.805123:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428069.805132:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940159616:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428069.805156:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc193c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428069.808563:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.808671:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702528 00000100:00100000:3.0:1789428069.808682:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702528 00010000:00010000:3.0:1789428069.808729:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 25 pid: 17161 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428069.808943:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940159488:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428069.808956:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940159616:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428069.809045:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:3.0:1789428069.809056:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+25:2396:x1876350931702528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428069.809073:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428069.809080:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 25 pid: 17161 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.809092:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 25 pid: 17161 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.809114:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519b03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730103f expref: 25 pid: 17161 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.809130:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:3.0:1789428069.809136:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.809145:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.809170:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428069.809225:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:2396:x1876350931702528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 171us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428069.809233:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00010000:00010000:2.0:1789428069.809308:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428069.809450:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.809776:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702656 00000100:00100000:0.0:1789428069.809790:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702656 00010000:00010000:0.0:1789428069.809813:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428069.809839:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1789428069.809846:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:2394:x1876350931702656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428069.809855:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428069.809861:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809871:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809885:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8800/0x84fc867ede519aee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301038 expref: 24 pid: 19948 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809898:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428069.809902:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809910:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809918:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.809941:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428069.809958:0:17159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428069.809968:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:2394:x1876350931702656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 121us (517us total) trans 0 rc 0/0 00010000:00010000:2.0:1789428069.809969:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428069.809988:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000004:00200000:2.0:1789428069.810002:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789428069.810162:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730105b expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.810177:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730105b expref: 23 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.810184:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.810187:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789428069.810189:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428600, rc 0) 00000100:00100000:2.0:1789428069.810213:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15624:x1876350931702400:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5535us (5853us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789428069.810219:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:1.0:1789428069.813556:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.818571:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931702784 00000100:00100000:2.0:1789428069.818587:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931702784 00000100:00100000:2.0:1789428069.818675:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:2.0:1789428069.818687:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15624:x1876350931702784:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789428069.818713:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.818735:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b5e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301062 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.818811:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.818825:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.818837:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.818949:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 25 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.819177:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.819188:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.819191:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789428069.819195:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428800, rc 0) 00000100:00100000:2.0:1789428069.819255:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:15624:x1876350931702784:12345-192.168.202.24@tcp:101:dd.0 Request processed in 571us (5712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.819262:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:2.0:1789428069.831138:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428069.833775:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703040 00000100:00100000:3.0:1789428069.834028:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703040 00000100:00100000:3.0:1789428069.834108:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1789428069.834120:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+24:15624:x1876350931703040:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:3.0:1789428069.834338:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.834356:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.834368:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789428069.834434:0:19948:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789428069.834456:0:19948:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c381c263 reply state 00000000d94d5a98 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.834468:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428069.834476:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:3.0:1789428069.834479:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789428069.834483:0:19948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789428069.838369:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703040:12345-192.168.202.24@tcp:36:dd.0 Request processed in 4240us (7229us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789428069.838411:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000020:00080000:3.0:1789428069.838435:0:19948:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789428069.846572:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.846860:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703168 00000100:00100000:2.0:1789428069.846870:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703168 00000100:00100000:2.0:1789428069.846929:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:2.0:1789428069.846940:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703168:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789428069.846965:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428069.846999:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301069 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.847057:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301069 expref: 28 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.847071:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301069 expref: 28 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.847091:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.847094:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428069.847098:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429e00, rc 0) 00000100:00100000:2.0:1789428069.848033:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15624:x1876350931703168:12345-192.168.202.24@tcp:101:dd.0 Request processed in 1090us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.848042:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1789428069.887319:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.887481:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703424 00000100:00100000:2.0:1789428069.887492:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703424 00000100:00100000:2.0:1789428069.887558:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1789428069.887569:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15624:x1876350931703424:12345-192.168.202.24@tcp:103:dd.0 00010000:00010000:2.0:1789428069.887585:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428069.887608:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301069 expref: 28 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.887628:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428069.887634:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428069.887700:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703424:12345-192.168.202.24@tcp:103:dd.0 Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.887707:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:3.0:1789428069.892212:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428069.892801:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703552 00000100:00100000:2.0:1789428069.892812:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703552 00000100:00100000:2.0:1789428069.892881:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:2.0:1789428069.892891:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703552:12345-192.168.202.24@tcp:58:dd.0 00010000:00010000:2.0:1789428069.892999:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.893016:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428069.893028:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428069.895069:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428069.895314:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789428069.895736:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789428069.895857:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703552:12345-192.168.202.24@tcp:58:dd.0 Request processed in 2962us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428069.895867:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1789428069.903206:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428069.903306:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703680 00000100:00100000:0.0:1789428069.903318:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703680 00000100:00100000:0.0:1789428069.903388:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1789428069.903398:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+27:15624:x1876350931703680:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789428069.903462:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428069.903485:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301070 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903541:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903552:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 28 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903571:0:17160:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903583:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 28 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903597:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428069.903600:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789428069.903604:0:17160:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 28 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428069.903611:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209000, rc 0) 00000100:00100000:0.0:1789428069.903994:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15624:x1876350931703680:12345-192.168.202.24@tcp:101:dd.0 Request processed in 595us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428069.904001:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000040:00080000:3.0:1789428070.065355:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428070.130716:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789428070.448705:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789428070.448715:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789428070.448760:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789428070.448775:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789428070.448904:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17192:1876350940159744:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789428070.449002:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff91958252d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789428070.458010:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17192:1876350940159744:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789428070.459078:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.469338:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703808 00000100:00100000:2.0:1789428070.469356:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703808 00000100:00100000:2.0:1789428070.469493:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1789428070.469504:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15627:x1876350931703808:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789428070.469543:0:19948:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789428070.469671:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15627:x1876350931703808:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 169us (10595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.470151:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1789428070.485539:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.485730:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931703936 00000100:00100000:2.0:1789428070.485741:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931703936 00000100:00100000:2.0:1789428070.485816:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:2.0:1789428070.485828:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15627:x1876350931703936:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789428070.485896:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.485915:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.485928:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486089:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486099:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486107:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486131:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486141:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486147:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428070.486193:0:17161:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789428070.486197:0:17161:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428070.486214:0:17161:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486233:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486239:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486246:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486252:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.486257:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486264:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486276:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d4ea00) 00010000:00010000:2.0:1789428070.486279:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428070.486283:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486289:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519b88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486302:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486308:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486315:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486325:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.486328:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486335:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486341:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff919581d49d00) 00010000:00010000:2.0:1789428070.486343:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428070.486346:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486351:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519b8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486363:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486398:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486405:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486409:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.486412:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486552:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486572:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428070.486575:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428070.486578:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.486584:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519b96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.486666:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15627:x1876350931703936:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 839us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.486674:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789428070.495331:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.497585:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931704192 00000100:00100000:3.0:1789428070.497599:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931704192 00000100:00100000:3.0:1789428070.497675:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789428070.497685:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+28:15627:x1876350931704192:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.497712:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428070.497737:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519b9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301077 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.497843:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.497860:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.497872:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428070.497885:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789428070.497966:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.497987:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498008:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498014:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e8c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428070.498019:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498027:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498039:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:3.0:1789428070.498042:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789428070.498047:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498053:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8c00/0x84fc867ede519ba4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498099:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519b9d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301077 expref: 30 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498110:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d4ea00) 00010000:00010000:3.0:1789428070.498112:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789428070.498116:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519b9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301077 expref: 30 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.498125:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8e00, rc 0) 00000100:00100000:3.0:1789428070.498191:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+29:15627:x1876350931704192:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 507us (2868us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789428070.498207:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:0.0:1789428070.500589:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.500714:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931704320 00000100:00100000:3.0:1789428070.500724:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931704320 00000100:00100000:3.0:1789428070.500777:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1789428070.500786:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+29:15627:x1876350931704320:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789428070.500818:0:17160:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789428070.500931:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+29:15627:x1876350931704320:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.500938:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1789428070.505750:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.505847:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931704576 00000100:00100000:3.0:1789428070.505857:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931704576 00000100:00100000:3.0:1789428070.506029:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1789428070.506042:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+29:15627:x1876350931704576:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.506065:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428070.506407:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede519bb2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730107e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789428070.506885:0:17159:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1789428070.506892:0:17159:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789428070.506914:0:17159:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789428070.507509:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede519bb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.507525:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede519bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.507601:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede519bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.507673:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9e00/0x84fc867ede519bb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730107e expref: 32 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.507693:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede519bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730107e expref: 31 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.507702:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9196989f7e00) 00010000:00010000:3.0:1789428070.507704:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789428070.507708:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9000, rc 0) 00000100:00100000:3.0:1789428070.507772:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+31:15627:x1876350931704576:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1733us (2032us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789428070.507781:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:1.0:1789428070.510691:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.510756:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931704832 00000100:00100000:3.0:1789428070.510766:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931704832 00000100:00100000:3.0:1789428070.510827:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:3.0:1789428070.510837:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+31:15627:x1876350931704832:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.510902:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428070.510929:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9000/0x84fc867ede519bb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730107e expref: 31 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.510945:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9196989f7e00) 00010000:00010000:3.0:1789428070.510955:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789428070.510975:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.510989:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511013:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511029:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511037:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511043:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511087:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511095:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511103:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511109:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428070.511114:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511122:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511132:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:3.0:1789428070.511134:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428070.511139:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511151:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519bc7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511162:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511168:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511174:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511179:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428070.511183:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511189:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511196:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x936f36a4 (ffff9196989f7700) 00010000:00010000:3.0:1789428070.511199:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428070.511202:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.511208:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9a00/0x84fc867ede519bce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x936f36a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428070.511482:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+30:15627:x1876350931704832:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 645us (801us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428070.511490:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1789428070.513965:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.514074:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931704960 00000100:00100000:2.0:1789428070.514084:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931704960 00000100:00100000:2.0:1789428070.514212:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:2.0:1789428070.514223:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+30:15627:x1876350931704960:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428070.514243:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428070.514264:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519bd5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301085 expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514310:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519bdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514323:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519bdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514334:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519bdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514585:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519bd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301085 expref: 32 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514609:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519bdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301085 expref: 31 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.514618:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:2.0:1789428070.514621:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789428070.514624:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429200, rc 0) 00000100:00100000:2.0:1789428070.514682:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919584448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+31:15627:x1876350931704960:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 460us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.514689:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1789428070.517831:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.517919:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931705216 00000100:00100000:2.0:1789428070.517929:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931705216 00000100:00100000:2.0:1789428070.518021:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:2.0:1789428070.518032:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+31:15627:x1876350931705216:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789428070.518117:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.518137:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.518162:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428070.518387:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789428070.518399:0:17161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415012982579ns, next at 416012980294ns, rc = 0 00000004:00010000:2.0:1789428070.518678:0:17161:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c6bef38 reply state 000000002a9d2475 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.518713:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.518722:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:2.0:1789428070.518725:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789428070.518730:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789428070.518892:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+33:15627:x1876350931705216:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 861us (1070us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789428070.518900:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1789428070.521676:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.521751:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931705344 00000100:00100000:3.0:1789428070.521760:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931705344 00000100:00100000:3.0:1789428070.521838:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1789428070.521848:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+33:15627:x1876350931705344:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.521870:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428070.521890:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730108c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.521943:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 34 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.521957:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 34 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.521975:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:3.0:1789428070.521978:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789428070.521982:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8e00, rc 0) 00000100:00100000:3.0:1789428070.522039:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+34:15627:x1876350931705344:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 193us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.522045:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:0.0:1789428070.524783:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.524892:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931705472 00000100:00100000:3.0:1789428070.524905:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931705472 00000100:00100000:0.0:1789428070.525126:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1789428070.525136:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2397:x1876350931705472:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789428070.525592:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2397:x1876350931705472:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 456us (817us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789428070.525600:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00080000:1.0:1789428070.525998:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789428070.533038:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.533323:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931705728 00000100:00100000:0.0:1789428070.533335:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931705728 00000100:00100000:0.0:1789428070.533402:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:0.0:1789428070.533412:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+34:15627:x1876350931705728:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789428070.533665:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+35:15627:x1876350931705728:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 254us (636us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789428070.533672:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1789428070.536266:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.536347:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931705984 00000100:00100000:3.0:1789428070.536357:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931705984 00000100:00100000:3.0:1789428070.536463:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:3.0:1789428070.536474:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+35:15627:x1876350931705984:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789428070.536580:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+35:15627:x1876350931705984:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.536601:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:3.0:1789428070.539051:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.539154:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931706112 00000100:00100000:2.0:1789428070.539162:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931706112 00000100:00100000:2.0:1789428070.539219:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:2.0:1789428070.539231:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+35:15627:x1876350931706112:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428070.539252:0:19948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428070.539275:0:19948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519bf1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301093 expref: -99 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539359:0:19948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539385:0:19948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539400:0:19948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428070.539494:0:19948:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428070.539533:0:19948:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539562:0:19948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519bf1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301093 expref: 37 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539580:0:19948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301093 expref: 36 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.539589:0:19948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:2.0:1789428070.539592:0:19948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789428070.539596:0:19948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789428070.539662:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+36:15627:x1876350931706112:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 433us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.539669:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1789428070.543378:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.543549:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931706240 00000100:00100000:2.0:1789428070.543560:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931706240 00000100:00100000:2.0:1789428070.543622:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1789428070.543632:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+6:2396:x1876350931706240:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428070.543650:0:18664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428070.543671:0:18664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730109a expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789428070.543700:0:18664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa88166, blocks: 0x0 00010000:00010000:2.0:1789428070.543719:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1789428070.543724:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428070.543734:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 7 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.543776:0:18664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 7 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.543790:0:18664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789428070.543846:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b66ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2396:x1876350931706240:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 215us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.543854:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:1.0:1789428070.546969:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.547052:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931706496 00000100:00100000:3.0:1789428070.547062:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931706496 00000100:00100000:3.0:1789428070.547123:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:3.0:1789428070.547133:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+36:15627:x1876350931706496:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789428070.547243:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+36:15627:x1876350931706496:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.547251:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:0.0:1789428070.553052:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.553131:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931706624 00000100:00100000:2.0:1789428070.553139:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931706624 00000100:00100000:2.0:1789428070.553185:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1789428070.553192:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+36:15627:x1876350931706624:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789428070.556769:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789428070.556793:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789428070.556843:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789428070.556930:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.556945:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.556961:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.556968:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428070.556972:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.556981:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.556998:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:0.0:1789428070.557001:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789428070.557007:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.557012:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede519a8c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557166:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557177:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15627:x1876350931706624:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 3977us (4128us total) trans 0 rc 0/0 00010000:00010000:1.0:1789428070.557179:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557192:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557193:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00010000:00010000:1.0:1789428070.557202:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428070.557206:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557213:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557223:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919581d49000) 00010000:00010000:1.0:1789428070.557227:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789428070.557227:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789428070.557238:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557244:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940159872:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789428070.557248:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428000/0x84fc867ede519a38 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557268:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557275:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557282:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557288:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428070.557291:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557296:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557316:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:1.0:1789428070.557318:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428070.557321:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557326:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428e00/0x84fc867ede519a3f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557339:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557355:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557360:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557365:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375cc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428070.557378:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557385:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557389:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428070.557401:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9196989f7b00) 00010000:00010000:1.0:1789428070.557404:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428070.557407:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557442:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375cc00/0x84fc867ede519ae7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557459:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557465:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557470:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557476:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e8600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428070.557485:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557492:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557502:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:1.0:1789428070.557505:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428070.557509:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557519:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8600/0x84fc867ede519b6c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557529:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940159872 00010000:00010000:1.0:1789428070.557534:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557537:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940159872 00010000:00010000:1.0:1789428070.557545:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557551:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557556:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429e00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428070.557559:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557565:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557572:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:1.0:1789428070.557574:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789428070.557583:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.557587:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429e00/0x84fc867ede519be3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.557670:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428070.557681:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940159872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789428070.557819:0:18665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789428070.557828:0:18665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789428070.557831:0:18665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789428070.557834:0:18665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789428070 -> 1789428070 00002000:00010000:0.0:1789428070.557837:0:18665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:1.0:1789428070.557868:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428070.558114:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940159872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 434us (726us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789428070.558122:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789428070.558342:0:3613:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919583fc3100/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789428070.558349:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940159872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789428070.561933:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.562046:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931706752 00000100:00100000:2.0:1789428070.562056:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931706752 00000100:00100000:2.0:1789428070.562118:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:2.0:1789428070.562129:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2397:x1876350931706752:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789428070.562236:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2397:x1876350931706752:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.562244:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:3.0:1789428070.570734:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.570827:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707008 00000100:00100000:0.0:1789428070.570838:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707008 00000100:00100000:0.0:1789428070.570904:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1789428070.570915:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+15:15627:x1876350931707008:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789428070.570977:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428070.571003:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede519bf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301093 expref: 15 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.571023:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:0.0:1789428070.571029:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789428070.571061:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.571075:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.571084:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428070.571216:0:17160:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cf2c91d3 reply state 0000000021816f4e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.571247:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.571253:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:0.0:1789428070.571256:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789428070.571258:0:17160:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789428070.571364:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:15627:x1876350931707008:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 450us (642us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789428070.571379:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1789428070.576104:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.576221:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707136 00000100:00100000:3.0:1789428070.576231:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707136 00000100:00100000:3.0:1789428070.576290:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:3.0:1789428070.576310:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:15627:x1876350931707136:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.576327:0:18665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428070.576344:0:18665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73010a1 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.576387:0:18665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.576396:0:18665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428070.576459:0:18665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428070.576466:0:18665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.576576:0:18665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.576591:0:18665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.576619:0:18665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18665:1876350940160000:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428070.576700:0:18665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b6628900 going to sleep for 11 seconds 00000100:00100000:2.0:1789428070.580412:0:18665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18665:1876350940160000:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428070.580501:0:18665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.580523:0:18665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9a00, rc 0) 00000100:00100000:2.0:1789428070.580581:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+8:15627:x1876350931707136:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 4281us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.580590:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:3.0:1789428070.581222:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.581366:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707264 00000100:00100000:0.0:1789428070.581382:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707264 00010000:00010000:0.0:1789428070.581437:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.581481:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789428070.581490:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+8:2397:x1876350931707264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428070.581505:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428070.581527:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.581540:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.581561:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059fbc27c/0x84fc867ede519bff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730109a expref: 8 pid: 18664 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.581592:0:17146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428070.581596:0:17146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428070.581602:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 7 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.581612:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 7 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.581646:0:17146:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 7 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.581660:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17146:1876350940160128:192.168.202.24@tcp:105: 00000100:00100000:0.0:1789428070.581733:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428070.586110:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17146:1876350940160128:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789428070.586142:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428070.586203:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2397:x1876350931707264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4712us (4982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.586214:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:2.0:1789428070.587493:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.587563:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707392 00000100:00100000:3.0:1789428070.587572:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707392 00000100:00100000:3.0:1789428070.587631:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:3.0:1789428070.587640:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2396:x1876350931707392:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789428070.587796:0:18664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789428070.587800:0:18664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789428069 00002000:00010000:3.0:1789428070.587802:0:18664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789428068 00002000:00010000:3.0:1789428070.587804:0:18664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789428070 -> 1789428069 00002000:00010000:3.0:1789428070.587806:0:18664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789428070.587858:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+8:2396:x1876350931707392:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 218us (371us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789428070.587865:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1789428070.590745:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.590842:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707520 00000100:00100000:0.0:1789428070.590852:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707520 00000100:00100000:0.0:1789428070.590916:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:0.0:1789428070.590927:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+8:2395:x1876350931707520:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789428070.590969:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.590990:0:18663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.591000:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428070.591017:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789428070.591022:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.591061:0:18663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.591077:0:18663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.591092:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18663:1876350940160256:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789428070.591177:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428070.594716:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.594908:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707648 00000100:00100000:3.0:1789428070.594919:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707648 00010000:00010000:3.0:1789428070.594962:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 9 pid: 18665 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428070.595005:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428070.595017:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:2396:x1876350931707648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428070.595033:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428070.595055:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 9 pid: 18665 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.595082:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 9 pid: 18665 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.595108:0:17144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789428070.595113:0:17144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789428070.595119:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.595129:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.595325:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428070.595387:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+9:2396:x1876350931707648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 373us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.595395:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00010000:00010000:0.0:1789428070.595609:0:18663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b03714d/0x84fc867ede519c0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a1 expref: 8 pid: 18665 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.595624:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18663:1876350940160256:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789428070.595646:0:18663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595657:0:18663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595664:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595683:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595698:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595706:0:18663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595713:0:18663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428070.595718:0:18663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595725:0:18663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595737:0:18663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.595744:0:18663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c80bcb/0x84fc867ede519c14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.595799:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2395:x1876350931707520:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 4874us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428070.595953:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1789428070.603094:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428070.603157:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931707904 00000100:00100000:3.0:1789428070.603167:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931707904 00000100:00100000:3.0:1789428070.603279:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:3.0:1789428070.603290:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:15627:x1876350931707904:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789428070.603387:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.603404:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.603458:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.603507:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428070.603520:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 16 pid: 17161 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428070.603533:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160384:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428070.603603:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b66286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428070.606999:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428070.607212:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708032 00000100:00100000:1.0:1789428070.607221:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708032 00010000:00010000:1.0:1789428070.607260:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 17 pid: 17161 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428070.607300:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1789428070.607311:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:2396:x1876350931708032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428070.607325:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428070.607332:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 17 pid: 17161 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607344:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 17 pid: 17161 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607364:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:1.0:1789428070.607383:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 17 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607394:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607402:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607450:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.607470:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428070.607526:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:2396:x1876350931708032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 216us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428070.607533:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00010000:00010000:2.0:1789428070.607560:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428800/0x84fc867ede519b65 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301062 expref: 16 pid: 17161 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.607575:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160384:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428070.607596:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607611:0:17159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607617:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607807:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607818:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 16 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607826:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607852:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 16 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.607866:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 16 pid: 17159 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.607878:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160512:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428070.607940:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428070.612108:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.612259:0:20183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708160 00000100:00100000:0.0:1789428070.612268:0:20183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708160 00010000:00010000:0.0:1789428070.612382:0:20183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 17 pid: 17159 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.612454:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789428070.612464:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:2397:x1876350931708160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428070.612479:0:20183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428070.612486:0:20183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 17 pid: 17159 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.612497:0:20183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 17 pid: 17159 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.612518:0:20183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:0.0:1789428070.612523:0:20183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.612533:0:20183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.612540:0:20183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.612556:0:20183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428070.612607:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+17:2397:x1876350931708160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 145us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428070.612614:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00010000:00010000:2.0:1789428070.612838:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e8e00/0x84fc867ede519bea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730108c expref: 16 pid: 17159 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.612854:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160512:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428070.612872:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.612888:0:17159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.612895:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789428070.612991:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789428070.613088:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789428070.613115:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789428070.613240:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17159:1876350940160640:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789428070.613281:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428070.613410:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adc19480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428070.613563:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940160640 00000100:00100000:0.0:1789428070.613570:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940160640 00000100:00100000:1.0:1789428070.613694:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789428070.613704:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17159:x1876350940160640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789428070.613786:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17159:x1876350940160640:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428070.613793:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789428070.613844:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17159:1876350940160640:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789428070.613965:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789428070.614006:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17159:1876350940160768:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789428070.614030:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428070.614099:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428070.614232:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940160768 00000100:00100000:3.0:1789428070.614237:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940160768 00000100:00100000:3.0:1789428070.614259:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789428070.614265:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1876350940160768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789428070.614378:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17159:x1876350940160768:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (337us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789428070.614385:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789428070.614464:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17159:1876350940160768:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789428070.614493:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614502:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614509:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614515:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.614528:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614537:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614549:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:2.0:1789428070.614552:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428070.614556:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614562:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428400/0x84fc867ede519c22 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614587:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614592:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614597:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614601:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.614604:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614609:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614616:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428070.614618:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428070.614628:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614639:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614648:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.614692:0:17159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.614703:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff02300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160896:192.168.202.24@tcp:105: 00000100:00100000:2.0:1789428070.614756:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428070.622264:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff02300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17159:1876350940160896:192.168.202.24@tcp:105: 00010000:00010000:2.0:1789428070.622295:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622307:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede519b7a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622341:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622355:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622382:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622412:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622471:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622479:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622486:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.622490:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622497:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622511:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428070.622513:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428070.622517:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622522:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede519c29 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622530:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622536:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622541:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622553:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428070.622555:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622560:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622568:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:2.0:1789428070.622569:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789428070.622572:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.622577:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196c21e9200/0x84fc867ede519c1b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.622756:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15627:x1876350931707904:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 19467us (19668us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789428070.622767:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000020:00080000:2.0:1789428070.622774:0:17159:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789428070.623531:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789428070.623537:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789428070.623554:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789428070.623561:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789428070.623639:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.623710:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708288 00000100:00100000:0.0:1789428070.623718:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708288 00000100:00100000:0.0:1789428070.623772:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:0.0:1789428070.623782:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583de5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15624:x1876350931708288:12345-192.168.202.24@tcp:49:dd.0 00000100:00100000:0.0:1789428070.623888:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583de5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15624:x1876350931708288:12345-192.168.202.24@tcp:49:dd.0 Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428070.623895:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789428070.631162:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428070.631309:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708416 00000100:00100000:0.0:1789428070.631320:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708416 00000100:00100000:0.0:1789428070.631389:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1789428070.631400:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+19:15624:x1876350931708416:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789428070.631456:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428070.631478:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519c30 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73010a8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631511:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519c37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631525:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631537:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631648:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208a00/0x84fc867ede519c30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a8 expref: 21 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631665:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519c37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a8 expref: 20 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.631684:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428070.631687:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789428070.631691:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208600, rc 0) 00000100:00100000:0.0:1789428070.631944:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+20:15624:x1876350931708416:12345-192.168.202.24@tcp:101:dd.0 Request processed in 545us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428070.631951:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:3.0:1789428070.640136:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428070.644814:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708672 00000100:00100000:1.0:1789428070.644831:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708672 00000100:00100000:1.0:1789428070.644913:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:1.0:1789428070.644925:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+20:15627:x1876350931708672:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789428070.646453:0:17163:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789428070.646487:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789428070.646521:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646537:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646565:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646574:0:17163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646580:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646586:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.646599:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789428070.646697:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15627:x1876350931708672:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1773us (6569us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789428070.646706:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000020:00080000:1.0:1789428070.646711:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789428070.648719:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428070.648732:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.648742:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fa00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428070.648746:0:20182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.648755:0:20182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.648772:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:0.0:1789428070.648775:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789428070.648780:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.648788:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fa00/0x84fc867ede519c3e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428070.648804:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428070.648806:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428070.648807:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428070.708140:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789428070.708167:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789428070.708240:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428070.708288:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161024 00000100:00100000:2.0:1789428070.708296:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161024 00000100:00100000:2.0:1789428070.708352:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428070.708361:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940161024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789428070.708399:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428070.708476:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940161024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.708499:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789428070.708520:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428070.708559:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428070.709004:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428070.709023:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940161152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428070.709058:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428070.709151:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161152 00000100:00100000:1.0:1789428070.709158:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161152 00000100:00100000:1.0:1789428070.709198:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789428070.709204:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940161152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428070.709216:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428070.709255:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940161152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428070.709261:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789428070.709355:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940161152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789428070.709410:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428070.787059:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.787271:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708800 00000100:00100000:2.0:1789428070.787281:0:18669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708800 00000100:00100000:2.0:1789428070.787350:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789428070.787360:0:18669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2397:x1876350931708800:12345-192.168.202.24@tcp:4:dd.0 00002000:00010000:2.0:1789428070.787462:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa88165, atime: 0x6aa88164, ctime: 0x6aa88165, blocks: 0x0 00010000:00010000:2.0:1789428070.787472:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.787488:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1789428070.787493:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428070.787499:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428070.787513:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428070.791194:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428070.791310:0:18671:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789428070.791321:0:18671:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789428070.792647:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931708928 00000100:00100000:0.0:1789428070.792661:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931708928 00000100:00100000:1.0:1789428070.793208:0:20297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1789428070.793232:0:20297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+8:2396:x1876350931708928:12345-192.168.202.24@tcp:4:dd.0 00010000:00010000:1.0:1789428070.793277:0:20297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.793296:0:20297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428070.793300:0:20297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428070.793307:0:20297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.793322:0:20297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789428070.856223:0:19476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789428070.856243:0:19476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1789428070.856629:0:18669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789428070.856634:0:18669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789428069 -> 1789428070 00002000:00010000:1.0:1789428070.856636:0:18669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789428069 -> 1789428070 00002000:00010000:1.0:1789428070.856637:0:18669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1789428070.856653:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856663:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856670:0:18669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856675:0:18669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428070.856678:0:18669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856699:0:18669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856717:0:18669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.856721:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede519c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428070.857014:0:18669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+7:2397:x1876350931708800:12345-192.168.202.24@tcp:4:dd.0 Request processed in 69589us (69897us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789428070.857027:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000001:00080000:2.0:1789428070.881133:0:19476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789428070.881445:0:20297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1789428070.881450:0:20297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1789428070.881468:0:20297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881481:0:20297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881490:0:20297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881497:0:20297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ec00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428070.881502:0:20297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881512:0:20297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881548:0:20297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428070.881557:0:20297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a53cfe6/0x84fc867ede519c4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428070.881704:0:20297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2396:x1876350931708928:12345-192.168.202.24@tcp:4:dd.0 Request processed in 88480us (90512us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789428070.881715:0:20297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:2.0:1789428070.885238:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885277:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885319:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885348:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885361:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885386:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885403:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709568 00000100:00100000:2.0:1789428070.885410:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709568 00000100:00100000:2.0:1789428070.885486:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709184 00000100:00100000:2.0:1789428070.885489:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709184 00000100:00100000:2.0:1789428070.885498:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709440 00000100:00100000:2.0:1789428070.885499:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709440 00000100:00100000:2.0:1789428070.885508:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:2.0:1789428070.885515:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709568:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885566:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709568:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885571:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:2.0:1789428070.885581:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1789428070.885585:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2397:x1876350931709184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885597:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2397:x1876350931709184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 12us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885600:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1789428070.885606:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:2.0:1789428070.885609:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2397:x1876350931709440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885625:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2397:x1876350931709440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 15us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885628:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:2.0:1789428070.885653:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428070.885674:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709312 00000100:00100000:2.0:1789428070.885676:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709312 00000100:00100000:2.0:1789428070.885696:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709824 00000100:00100000:2.0:1789428070.885698:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709824 00000100:00100000:2.0:1789428070.885706:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709696 00000100:00100000:2.0:1789428070.885707:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709696 00000100:00100000:2.0:1789428070.885714:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789428070.885718:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2397:x1876350931709312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885735:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2397:x1876350931709312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 17us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885739:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1789428070.885746:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789428070.885749:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885760:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 11us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885763:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789428070.885768:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:2.0:1789428070.885771:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709696:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428070.885781:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2397:x1876350931709696:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 10us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428070.885784:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00080000:2.0:1789428070.885793:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789428070.885795:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428070.886236:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709056 00000100:00100000:3.0:1789428070.886242:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709056 00000100:00100000:3.0:1789428070.886279:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:3.0:1789428070.886290:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2397:x1876350931709056:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428070.886327:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2397:x1876350931709056:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428070.886333:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 163 00010000:00010000:0.0:1789428071.152621:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428071.216641:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940161280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789428071.216735:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.216841:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161280 00000100:00100000:2.0:1789428071.216850:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161280 00000100:00100000:2.0:1789428071.216919:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428071.216930:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940161280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789428071.216967:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1789428071.217016:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940161280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.217024:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428071.217071:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940161280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428071.217139:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940161408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428071.217168:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.217226:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161408 00000100:00100000:2.0:1789428071.217231:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161408 00000100:00100000:2.0:1789428071.217266:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428071.217275:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940161408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428071.217288:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940161664:0@lo:400:kworker.0 00002000:00000024:2.0:1789428071.217290:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1789428071.217332:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940161408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428071.217338:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.217346:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789428071.217379:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940162176:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217387:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940161792:0@lo:400:kworker.0 00000100:00100000:0.0:1789428071.217433:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.217458:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428071.217462:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789428071.217471:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940161536:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217485:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940162304:0@lo:400:kworker.0 00000100:00100000:0.0:1789428071.217505:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.217519:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428071.217538:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940162048:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217546:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789428071.217554:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940161920:0@lo:400:kworker.0 00000100:00100000:0.0:1789428071.217567:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428071.217588:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428071.217590:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940162560:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217614:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940162432:0@lo:400:kworker.0 00000100:00100000:0.0:1789428071.217621:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428071.217648:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161664 00000100:00100000:2.0:1789428071.217650:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428071.217654:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161664 00000100:00100000:0.0:1789428071.217690:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161920 00000100:00100000:2.0:1789428071.217691:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162176 00000100:00100000:0.0:1789428071.217694:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161920 00000100:00100000:2.0:1789428071.217698:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162176 00000100:00100000:2.0:1789428071.217726:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161792 00000100:00100000:2.0:1789428071.217730:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161792 00000100:00100000:2.0:1789428071.217741:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162304 00000100:00100000:2.0:1789428071.217743:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162304 00000100:00100000:2.0:1789428071.217754:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162048 00000100:00100000:2.0:1789428071.217757:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162048 00000100:00100000:2.0:1789428071.217768:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162560 00000100:00100000:2.0:1789428071.217770:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162560 00000100:00100000:2.0:1789428071.217782:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162432 00000100:00100000:2.0:1789428071.217784:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162432 00000100:00100000:2.0:1789428071.217797:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789428071.217804:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217840:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940162176:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.217846:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789428071.217858:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789428071.217864:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940161792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217893:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940161792:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.217900:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789428071.217911:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789428071.217915:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940162304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217937:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940162304:12345-0@lo:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.217942:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789428071.217951:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789428071.217956:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940162048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.217990:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940162048:12345-0@lo:400:kworker.0 Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.217995:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789428071.218008:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789428071.218014:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940162560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218039:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940162560:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.218044:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789428071.218055:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789428071.218062:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940162432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218084:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940162432:12345-0@lo:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.218089:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789428071.218115:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940162048:0@lo:400:kworker.0 00010000:00080000:2.0:1789428071.218132:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfb8ea00 x1876350940162560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428071.218142:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940162560:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218155:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940162176:0@lo:400:kworker.0 00000100:00100000:3.0:1789428071.218160:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940161536 00000100:00100000:3.0:1789428071.218166:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940161536 00000100:00100000:2.0:1789428071.218188:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940162432:0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218199:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940161792:0@lo:400:kworker.0 00000100:00100000:3.0:1789428071.218207:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00010000:00080000:2.0:1789428071.218212:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfb8c380 x1876350940162304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428071.218219:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940161536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218242:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940162304:0@lo:400:kworker.0 00000100:00100000:3.0:1789428071.218270:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940161536:12345-0@lo:400:kworker.0 Request processed in 54us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428071.218279:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789428071.218330:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940161536:0@lo:400:kworker.0 00000100:00100000:3.0:1789428071.218380:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789428071.218386:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919583fc3100, transno 8589934596 00000004:00080000:3.0:1789428071.218398:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789428071.218446:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940161408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428071.218516:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789428071.218528:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428071.218540:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789428071.218550:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428071.218583:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940161664:12345-0@lo:400:kworker.0 Request processed in 58us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428071.218599:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940161920:12345-0@lo:400:kworker.0 Request processed in 50us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428071.218604:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789428071.218612:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789428071.218650:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940161920:0@lo:400:kworker.0 00000100:00080000:1.0:1789428071.219173:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789428071.219177:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789428071.219179:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428071.219222:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940161664:0@lo:400:kworker.0 00000001:02000400:0.0:1789428072.070970:0:20334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789428072.177695:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428072.240659:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940162688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428072.240762:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428072.240802:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162688 00000100:00100000:3.0:1789428072.240811:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162688 00000100:00100000:3.0:1789428072.240910:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789428072.240931:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940162688:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428072.240964:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940162816:0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428072.240967:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789428072.241000:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428072.241023:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940162688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428072.241049:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789428072.241123:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940162688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789428072.241313:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162816 00000100:00100000:3.0:1789428072.241319:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162816 00000100:00100000:0.0:1789428072.241454:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789428072.241465:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940162816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428072.241487:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428072.241576:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940162816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428072.241582:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789428072.241952:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940162816:0@lo:41:osp-pre-1-0.0 Debug log: 41847 lines, 41847 kept, 0 dropped, 0 bad.